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1. Introduction 

This paper gives a complete classification of the spherical unitary dual of 
the split groups Sp(n) and So(n) over the real and p— adic field. While 
there is a large overlap with [Blj , [B2j , |B3j and |BM3j , the formulation of the 
answer is new, and so are a significant number of the techniques employed. 
Completely new is the proof of necessary conditions for unitarity in the real 
case. As is explained in these references, in general, in the p— adic case, the 
classification of the spherical unitary dual is equivalent to the classification of 
the unitary irreducible finite dimensional representations of an affine graded 
Hecke algebra. In concrete terms the problem then becomes to determine 
whether a certain hermitian form for each Weyl group representation is 
positive semidefinite. For the real case, following a suggestion of D. Vogan, 
I find a set of K— types which I call relevant which detect the nonunitarity. 
They have the property that they are in 1-1 correspondence with certain 
irreducible Weyl group representations (also called relevant) so that the 
hermitian forms are the same in the real and p— adic case. The fact that 
these relevant W— types detect unitarity in the p— adic case is also new. 
Thus the same proof applies in both cases. Since the answer is independent 
of the field, this establishes a form of the Lefschetz principle. 

Let G be a split symplectic or orthogonal group over a local field F which 
is either Mora p— adic field. Fix a maximal compact subgroup K. In the real 
case, there is only one conjugacy class. In the p— adic case, let K = GiJZ) 
where F D 1Z D V, with 1Z the ring of integers and V the maximal prime 
ideal. Fix also a rational Borel subgroup B = AN. Then G = KB. A 
representation (tt, V) (admissible) is called spherical if V K ^ (0). 

The classification of irreducible admissible spherical modules is well known. 
For every irreducible spherical tt, there is a character x € ^4 such that 
xUnx = triv, and tt is the unique spherical subquotient of Indfg[x® !]■ We 
will call a character \ whose restriction to Af)K is trivial, unramified. Write 
X(x) for the induced module (principal series) and L{x) for the irreducible 
spherical subquotient. Two such modules L{\) and L(x') are equivalent if 
and only if there is an element in the Weyl group W such that w\ = x' ■ An 
L(x) admits a nondegenerate hermitian form if and only if there is w 6 W 
such that wx = ~X- 
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The character x is called real if it takes only positive real values. For 
real groups, x is rea l if an d only if L(x) has real infinitesimal character ([Kj. 
chapter 16). As is proved there, any unitary representation of a real re- 
ductive group with nonreal infinitesimal character is unitarily induced from 
a unitary representation with real infinitesimal character on a proper Levi 
component. So for real groups it makes sense to consider only real infini- 
tesimal character. In the p— adic case, x is called real if the infinitesimal 
character is real in the sense of |BM2] . The results in [BMlj show that the 
problem of determining the unitary irreducible representations with Iwa- 
hori fixed vectors is equivalent to the same problem for the Iwahori-Hecke 
algebra. In |BM2j . it is shown that the problem of classifying the unitary 
dual for the Hecke algebra reduces to determining the unitary dual with real 
infinitesimal character of some smaller Hecke algebra (not necessarily one 
for a proper Levi subgroup). So for p— adic groups as well it is sufficient to 
consider only real X- 

So we start by parametrizing real unramified characters of A. Since G is 
split, A = (F x ) n where n is the rank. Define 

a* =X*(A)® Z R, (1.0.1) 

where X*(A) is the lattice of characters of the algebraic torus A. Each 
element v E a* defines an unramified character Xv of A, characterized by 
the formula 

Xu(r(f)) = \f\^\ / E F x , (1.0.2) 

where r is an element of the lattice of one parameter subgroups X*(A). Since 
the torus is split, each element of X*(A) can be regarded as a homomorphism 
of F x into A. The pairing in the exponent in (jl.0.2p corresponds to the 
natural identification of a* with HompC(A),M]. The map v — > Xv from a* 
to real unramified characters of A is an isomorphism. We will often identify 
the two sets writing simply x£n*. 

Let G be the (complex) dual group, and let A be the torus dual to A. 
Then a* <8>m C is canonically isomorphic to d, the Lie algebra of A. So we can 
regard x as an element of d. We attach to each x a nilpotent orbit 0{x) as 
follows. By the Jacobson-Morozov theorem, there is a 1-1 correspondence 
between nilpotent orbits O and G-conjugacy classes of Lie triples {e, h, /}; 
the correspondence satisfies e £ O. Choose the Lie triple such that h E d. 
Then there are many O such that x can be written as u>x = h/2 + v with 
v E j(e,/i, /), the centralizer in q of the triple. For example this is always 
possible with O = (0). The results in [BMlj guarantee that for any x there 
is a unique 0(x) satisfying 

(1) there exists w E W such that vox = \h + v with v E }(e, h, /), 

(2) if x satisfies property (1) for any other O' , then O' C 0(x)- 
Here is another characterization of the orbit 0(x)- Let 

01 := { x E Q : [x,x]=x}, q := {x E fj : [x, x] = }. 
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Then Go, the Lie group corresponding to the Lie algebra go has an open 
dense orbit in gi. Its G saturation in g is 0(x)- 

The pair {0{x),v) has further nice properties. For example assume that 
v = in (1) above. Then the representation L(x) is one of the parameters 
that the Arthur conjectures predict to play a role in the residual spectrum. 
In particular, L(x) should be unitary. In the p— adic case one can verify 
the unitarity directly as follows. In |BM1| it is shown how to calculate 
the Iwahori-Matsumoto dual of L(x) m the Kazhdan-Lusztig classification 
of representations with Iwahori- fixed vector. It turns out that in the case 
v = 0, it is a tempered module, and therefore unitary. Since the results 
in [BM1| show that the Iwahori-Matsumoto involution preserves unitarity, 
L(x) is unitary as well. In the real case, a direct proof of the unitarity of 
L(x) (still with v = as in (1) above) is given in |B3] . and in section [9] of 
this paper. 

In the classical Lie algebras, the centralizer j(e, h, /) is a product of sym- 
plectic and orthogonal Lie algebras. We will often abbreviate it as i{0). The 
orbit O is called distinguished if i(0) does not contain a nontrivial torus; 
equivalently, the orbit does not meet any proper Levi component. Let xxibc 
be the centralizer of a Cartan subalgebra in i{0). This is the Levi compo- 
nent of a parabolic subalgebra. The subalgebra rn.BC is the Levi subalgebra 
attached to O by the Bala-Carter classification of nilpotent orbits. The in- 
tersection of O with rn.BC is the other datum attached to O, a distinguished 
orbit in rn.BC- We will usually denote it v\bc{0) if we need to emphasize 
the dependence on the nilpotent orbit. Let Mbc C G be the Levi subgroup 
whose Lie algebra msc has rhsc as its dual. 

The parameter % gives rise to a spherical irreducible representation Lm bc (x) 
on Mbc as well as a L(x)- Then L(x) is the unique spherical irreducible sub- 
quotient of 

h.i BC {x) ■= Ind% BO [L MBO ( X )]- (1-0.3) 

To motivate why we consider Mbc{0)-> we need to recall some facts about 
the Kazhdan-Lusztig classification of representations with Iwahori fixed vec- 
tors in the p-adic case. Denote by r the Iwahori-Matsumoto involution. 
Then the space of Iwahori fixed vectors of t{L{x)) is a W— representation 
(see I5.2p . and contains the W— representation sgn. Irreducible representa- 
tions with Iwahori-fixed vectors are parametrized by Kazhdan-Lusztig data; 
these are G conjugacy classes of (e, x, tp) where e £ g is such that [x, e] = e, 
and t/j is an irreducible representation of the component group A(x, e). To 
each such parameter there is associated a standard module X(e, x> which 
contains a unique irreducible submodule L(e, XiVO- Ah other factors have 
parameters (e^x'^O such that 

6(e) c6{^), 0(e)^6(e'). 

As explained in section 4 and 8 in [BMlj . X(e', x', ip') contains sgn if and 
only if if;' = triv. Thus if we assume O satisfies (1) and (2) with respect 
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to X-, it follows that X(e,%, triv) = L(e,x,triv). We would like it to equal 
Imbc but this is not true. In general (for an M which contains Mbc), 
L(e,x,triv) = Ind^[[XM(e, X: triv)] if and only if the component Am(&,x) 
equals the component group A(e, x)- We will enlarge Mbc(@) to an Mkl so 
that Am kl (c, x) = A(e, x)- Note that if m C m', then Am(&, x) C Am\&-, x)- 
Then 

Ind M KL i x M KL (e, X, triv)} = X(e, x, triv) = L(e, x, triv), (1.0.4) 
and denoting 

hi KL (x) ■■= I nd% lKL [L Mkl (x)}, (1.0.5) 

the equality 

L( X ) = hi KL (x) (1-0.6) 
follows by applying r. We remark that Mkl depends on x as well as e. It 
will be described explicitly in section [2j A more general discussion about 
how canonical xtikl is, appears in [BC2j . 

In the real case, we use the same Levi components as in the p— adic case. 
Then equality (|1.0.6p does not hold for any proper Levi component. A result 
essential for the paper is that equality does hold at the level of multiplicities 
of the relevant K— types (section [5.2[ see particularly equation (|2.2.6p ). 

We will use the data (O, v) to parametrize the unitary dual. Fix an O. A 
representation L(x) will be called a complementary series attached to O, if 
it is unitary, and 0{x) = O. To describe it, we need to give the set of v such 
that L(x) with x — h/2 + v is unitary. Viewed as an element of 3 (O), the 
element v gives rise to a spherical parameter ((0),z^) where (0) denotes the 
trivial nilpotent orbit. The main result in section [3T21 savs that the v giving 
rise to the complementary series for O coincide with the ones giving rise to 
the complementary series for (0) on 3 (O). This is suggestive of Langlands 
functoriality. 

It is natural to conjecture that such a result will hold for all split groups. 
Recent work of D. Ciubotaru for F4, and by D. Ciubotaru and myself for 
Eq, Ej, Eg, show that this is generally true, but there are exceptions. 

I give a more detailed outline of the paper. Section [2] reviews notation 
from earlier papers. Section [3] gives a statement of the main results. A rep- 
resentation is called spherical unipotent if its parameter is of the form h/2 
for the neutral element of a Lie triple associated to a nilpotent orbit O. The 
unitarity of the spherical unipotent representations is dealt with in section 
[9l For the p— adic case I simply cite [BM3 . The unitarity is a consequence 
of the fact that the Iwahori-Matsumoto involution preserves unitarity, and 
spehrical unipotent representations correspond to tempered representations. 
The real case (sketched in |B2| ) is more involved. It is redone in section WM 
The proofs are simpler than the original ones because I take advantage of 
the fact that wave front sets, asymptotic supports and associated varieties 
"coincide" due to [SVj . Section Yl . 1 1 proves an irreducibility result in the real 
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case which is clear in the p— adic case from the work of Kazhdan-Lusztig. 
This is needed for determining the complementary series (definition 13.11 in 
section 13. ip . Sections 0] and [5] deal with the nonunitarity. The decom- 
position x = h/2 + v is introduced in section [3l It is more common to 
parametrize the x by representatives in d which are dominant with respect 
to some positive root system. We use Bourbaki's standard realization of the 
positive system. It is quite messy to determine the data (O, v) from a dom- 
inant parameter, because of the nature of the nilpotent orbits and the Weyl 
group. Sections 12.3112.81 give a combinatorial description of (0,is) starting 
from a dominant x- Siddhartha Sahi made significant contributions to the 
phrasing of these algorithms. 

In the classical cases, the orbit O is given in terms of partitions. To such 
a partition we associate the Levi component 

mhc ■= x • • • x 9l( a k) x 0o(™o) 

given by the Bala-Carter classification. (The go in this formula is not related 
to the one just after conditions (1) and (2)). The intersection of O with rn.BC 
is an orbit of the form 

(ai) x • • • x (a r ) x O 

where Oq is a distinguished nilpotent orbit, and (aj) is the principal nilpotent 
orbit on gliai). This is the distinguished orbit associated to O by Bala- 
Carter. Then x gives rise to irreducible spherical modules L(x) and Im bc (x) 
as in (|1.0.3p and Im kl {x) as m <|l-0-6|) ■ The module L(x) is the irreducible 
spherical subquotient of Im(x)- As already mentioned, Im kl {x) = L{x) in 
the p— adic case, but not the real case. In all cases, the multiplicities of the 
relevant K— types in L(x), Im kl {x) coincide (section [2T9l and [5^2]) . These are 
representations of the Weyl group in the p— adic case, representations of the 
maximal compact subgroup in the real case. Their definition is in chapter 
0J they are a small finite set of representations which provide necessary 
conditions for unitarity which are also sufficient. Their role is outlined at 
the beginning of chapter [H In particular the issue is addressed of how 
the relevant K— types allow us to deal with the p— adic case only. A more 
general class of K— types for split real groups (named petite if -types), on 
which the intertwining operator is equal to the p-adic operator, is defined in 
|B6| . and the proofs are more conceptual. In |Odaj a more general notion 
of single petaled is studied independently, and for different purposes. The 
proofs in chapter |4] are the original ones, and included for completeness. 
The interested reader can also consult [BCPJ for more general results of 
this kind. The determination of the nonunitary parameters proceeds by 
induction on the rank of g and by the inclusion relations of the closure of the 
orbit O. Section [5] completes the induction step; it shows that conditions (B) 
in section 13.11 are necessary. The last part of the induction step is actually 
done in sections 13.21 and 13.31 
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2.1. Explicit Langlands parameters. We consider spherical irreducible 
representations of the split connected classical groups of rank n of type 
B,C,D, precisely, G = So(2n + 1), G = Sp(2n) and G = So(2n). These 
groups will be denoted by G(n) when there is no danger of confusion (n is 
the rank). Levi components will be written as 



where Go (no) is the factor of the same type as G. The corresponding complex 
Lie algebras are denoted g(n) and m = gl(k\) x • • • x gl(k r ) x 0o(^o)- 

As already explained in the introduction, we deal with real unramified 
characters only, and this is sufficient for determining the full spherical uni- 
tary dual. 

In the case of classical groups, such a character can be represented by a 
vector of size the rank of the group. Two such vectors parametrize the same 
irreducible spherical module if they are conjugate via the Weyl group which 
acts by permutations and sign changes for type B, C and by permutations 
and an even number of sign changes in type D. 

For a given unramified x, let L(x) be the corresponding irreducible spher- 
ical module. We will occasionally refer to x as the infinitesimal character. 

For any nilpotent orbit Ocgwe attach an unramified parameter Xo ^ 
a* as follows. Recall from the introduction that a* (S>r C is canonically 
isomorphic to d. Let {e, h, /} be representatives for the Lie triple associated 
to a nilpotent orbit O. Then Xo := h/2. 

Conversely, to each x we wu l attach a nilpotent orbit O C Q and Levi 
components Mbc, Mkl '■= GL(k\) x • • • x GL(k r ) x Go (no). In addition we 
will specify an even nilpotent orbit (Do C fjo( n o) with unramified character 
Xo := Xo on 0o(^o)) and unramified characters Xi on the GL(ki). These 
data have the property that L(x) is the spherical subquotient of 



2. Description of the spherical parameters 



M = GL(ki) x • • • x GL(k r ) x G (n ) 




Ind' 



M KL l® L (Xi)®L(Xo)}. 
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2.2. We introduce the following notation (a variant of the one used by 
Zelevinski [ZE] ). 

Definition. A string is a sequence 

(a, a + 1, . . . , b - 1, b) 

of numbers increasing by 1 from a to b. A set of strings is called nested if 
for any two strings either the coordinates do not differ by integers, or if they 
do, then their coordinates, say {a\, . . . , b±) and (02, . . . , 02), satisfy 

fli < a-2 < 62 < b\ or 0,2 < «i < 61 < &2j (2.2.1) 

or 

&i + l<a 2 or 6 2 + Koi- □ (2.2.2) 

A sei 0/ strings is called strongly nested i/ the coordinates of any two strings 
either do not differ by integers or else satisfy h2.2.1\) . 

Each string represents a 1-dimensional spherical representation of a GL(rii) 
with ni = bi — ai + 1. The matchup is 

(a,...,b)< — ► |det| £ *\ of GL(b-a + l), (2.2.3) 

where det is the determinant character of GL{n). 

In the case of G = GL(n), we record the following result. For the p— adic 
case, it originates in the work of Zelevinski, and Bernstein- Zelevinski ( |ZE] 
and references therein). To each set of strings (a%, . . . , b±; . . . ; a,k, ■ ■ ■ , 
we can attach a Levi component Mbc '■= l~li<i<fc GL{ni), and an induced 
module 

I( X ):=Ind G ^\®L{Xi)] (2.2.4) 

where \% are obtained from the strings as in (|2.2.3[> . 

In general, if the set of strings is not nested, then the corresponding in- 
duced module is not irreducible. The coordinates of x i n a * — ^ n determine 
a set of nested strings as follows. Extract the longest string starting with the 
smallest coordinate in x- Continue, in the same way, to extract sequences 
from the remainder until there are no elements left. This set of strings is, 
up to the order of the strings, the unique set of nested strings one can form 
out of the entries of x- 

Theorem. Suppose ¥ is p-adic. Let (ai, . . . , 61; . . . a r , . . . , b r ) be a set of 
nested strings, and M := GL(b\ — a\ + 1) x ■ ■ ■ X GL(b r — a r + 1). Then 



L( X ) = Ind GL{n) 



det 2 det 



a r -\-b r 



In the language of section 12.11 Mbc = Mk l = M, where M is the one 
defined in the theorem. The nilpotent orbit O corresponds to the partition 
of n with entries (pi — a, + 1); it is the orbit 0{x) satisfying (1) and (2) in 
the introduction, with respect to x = ( a i> • • • > °ii • • • a r> ■ ■ ■ > K)- 
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For the real case (still GL(n)), the induced module in theorem 12.21 fails 
to be irreducible. However 

[H : L(x)\ = [n : Ind% L[n) | det | 2 | det | 2 (2.2.5) 

whenever /i is a relevant K— type. This is essential for many of the argu- 
ments. Relevant -RT-types will be defined in chapter HI particularly section 
K7\ 

We will generalize this procedure to the other classical groups. As before, 
the induced modules that we construct fail to be irreducible in the real case. 
Instead we will establish that 

dimHom/<[/i : L(x)\ = dimHom^[/i : Im kl (x)] (2.2.6) 

for relevant K— types, where Im kl (x) is defined by (jl.0.5p . and make essen- 
tial use of this fact. 



2.3. Nilpotent orbits. In this section we attach a set of parameters to 
each nilpotent orbit O C 0. Let {e, h, /} be a Lie triple so that eGO, and 
let i{0) be its centralizer. In order for x to be a parameter attached to O 
we require that 

X = h/2 + u, vE$(0), semisimple, (2.3.1) 

but also that if 

x = h'/2 + u', z/€3(0')> semisimple (2.3.2) 

for another nilpotent orbit & C g, then O' C O. In [BMlj . it is shown that 
the orbit of x-, uniquely determines O and the conjugacy class of v G l{0). 
We describe the pairs (0,u) explicitly in the classical cases. 
Nilpotent orbits are parametrized by partitions 

(l I _^,2,...,2,...,i,...,i,...), (2.3.3) 

ri r-2 Tj 

satisfying the following constraints. 

type A n -\\ gl(n), partitions of n. 

type B n : so(2n + 1), partitions of 2n + 1 such that every even part 
occurs an even number of times. 

type C n : sp(2n), partitions of 2n such that every odd part occurs 
an even number of times. 

type D n : so(2n), partitions of 2n such that every even part occurs 
an even number of times. In the case when every part of the parti- 
tion is even, there are two conjugacy classes of nilpotent orbits with 
the same Jordan blocks, labelled (I) and (II). The two orbits are 
conjugate under the action of 0(2n). 
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The Bala-Carter classification is particularly well suited for describing the 
parameter spaces attached to the O C Q. An orbit is called distinguished if it 
does not meet any proper Levi component. In type A, the only distinguished 
orbit is the principal nilpotent orbit, where the partition has only one part. 
In the other cases, the distinguished orbits are the ones where each part of 
the partition occurs at most once. In particular, these are even nilpotent 
orbits, i.e. adh has even eigenvalues only on q. Let O C Q be an arbitrary 
nilpotent orbit. We need to put it into as small as possible Levi component 
m. In type A, if the partition is (01, . . . , Oft), the Levi component is xhsc = 
gl(a\) x • • • x gl{ajS). In the other classical types, the orbit O meets a proper 
Levi component if and only if one of the rj > 1. So separate as many pairs 
(a, a) from the partition as possible, and rewrite it as 

((ai,oi), . . . , (a fc ,a fe );di, . . .,di), (2.3.4) 

with di < (ij+i. The Levi component msc attached to this nilpotent by 
Bala-Carter is 

™BC = gK a i) x • • • x 9 l ( a k) x flofao) n := n-^m, (2.3.5) 

The distinguished nilpotent orbit is the one with partition (di) on g(no), 
principal nilpotent on each gl(aj). The x °f the form h/2 + v are the ones 
with v an element of the center of vh-BC- The explicit form is 

(. . . ; -^-^ + Vi , . . . , ^± + v it ...; ho/2), (2.3.6) 

where ho is the middle element of a triple corresponding to (di). We will 
write out (di) and ho/ 2 in sections I2.4H2.71 

We will consider more general cases where we write the partition of O in 
the form (|2.3.4h so that the di are not necessarily distinct, but (di) forms an 
even nilpotent orbit in 0o( n o)- This will be the situation for m^. 

The parameter x determines an irreducible spherical module L(x) for G 
as well as an Lm(x) f° r M = Mbc or Mkl of the form 

Li(xi) <8> • • • ® L k ( Xk ) 8> L (xo), (2.3.7) 

where the Li(xi) i = l,...,k are one dimensional. We will consider the 
relation between the induced module 

I M (X) := Ind G M [L M (x)l (2.3.8) 

and L(x). 

2.4. G of Type A. We write the h/2 for a nilpotent O corresponding to 
(a%, ... , Ofc) with di < di+i as 
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The parameters of the form x = h/2 + v are then 

/ Gj 1 G'i 1 . . . 

(■■■;-- L 2- + ^,...,- L 2- + ^;-..)- (2-4.1) 

Conversely, given a parameter as a concatenation of strings 

X =(...;A l ,...,B l ;...), (2.4.2) 

it is of the form h/2 + v where h is the neutral element for the nilpotent orbit 
with partition (Ai + B, L + 1) (the parts need not be in any particular order) 
and V{ = Ai ~ Bi . We recall the following well known result about closures of 
nilpotent orbits. 

Lemma. Assume O and O' correspond to the (increasing) partitions (a±, . . . , a/.) 
and (b\, . . . ,bk) respectively, where some of the or bj may be zero in order 
to have the same number k. The following are equivalent 

(1) & C 6. 

(2) Zi>s^>T,i> s hforallk>s>l. 

Proposition. A parameter x as in h%-4-l\ ) * s attached to O in the sense of 
satisfying \2. 3.1\) and \2. 3. 2\) if and only if it is nested. 

Proof. Assume the strings are not nested. There must be two strings 

(A,...,B), (C,...,D) (2.4.3) 

such that A - C G Z, and A < C < B < D, or C = B + 1. Then by 
conjugating x by the Weyl group to a^, we can rearrange the coordinates 
of the two strings in (|2.4.3p so that the strings 

(A,...,D), (C,...B), or (A,...,B,B + 1 = C,...,D). (2.4.4) 

appear instead. Then by the lemma, x' = h'/2 + v' for a strictly larger 
nilpotent O' . 

Conversely, assume x = h/2 + u, so it is written as strings, and they 
are nested. The nilpotent orbit for which the neutral element is h/2 has 
partition given by the lengths of the strings, say (ai,...afc) in increasing 
order. If x is nested, then is the length of the longest string of entries we 
can extract from the coordinates of x> Ofe-i the longest string we can extract 
from the remaining coordinates and so on. Then (2) of lemma 12.41 precludes 
the possibility that some conjugate x' equals h! /2 + v 1 for a strictly larger 
nilpotent orbit. □ 

In type A, xtiKL = msc- 

2.5. G of Type B. Rearrange the parts of the partition of O C sp(2n,C), 
in the form (|2X4"|) . 

((ai,ai), . . . , (a k ,a k ); 2x , ■ ■ ■ ,2x 2m ) (2.5.1) 

The di have been relabeled as 2xi and a 2x$ = is added if necessary, to 
insure that there is an odd number. The x% are integers, because all the 
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odd parts of the partition of 6 occur an even number of times, and were 
therefore extracted as (at, Oj). The % of the form h/2 + v are 

1 

+ Vi;...; 

(2.5.2) 



where 

"1-1/2 = #{^ > I}- (2-5.3) 
Lemma [2.41 holds for this type verbatim. So the following proposition holds. 

Proposition. A parameter \ = h/2 + v cannot be conjugated to one of the 
form h' /2 + v' for any larger nilpotent O' if and only if 

[1) the set of strings satisfying + z/j — aj 2 — vj G Z are nested. 

i 

2 



(2) the strings satisfying ^h^- + z/j G 1/2 + Z satisfy the additional con- 
dition that either x 2m + 1/2 < — + or i/iere is j sitc/i that 



Xj + 1/2 < -^y^ + ^ < + ^ < - 1/2. (2.5.4) 

The Levi component xhxL is obtained from mgc as follows. Consider the 
strings for which aj is even, and = 0. If is not equal to any 2xj, then 
remove one pair (ttj,aj), and add two 2xj = ai to the last part of (|2.5.ip . 
For example, if the nilpotent orbit O is 

(2,2,2,3,3,4,4), (2.5.5) 

then the parameters of the form h/2 + v are 

( - 1/2 + ui, 1/2 + z/i; -1 + u 2 , v 2 , 1 + z/ 2 ; 

- 3/2 + z/ 3 , -1/2 + ^3, 1/2 + v 3 , 3/2 + i/ 3 ; 1/2) 



(2.5.6) 



The Levi component is rhec = <^(2) x gl(3) x 5/(4) x g(l). If i/ 3 / 0, then 
hVbc = ffiKx- But if z>3 = 0, then m^i = gl{2) x g/(3) x fl(5). The parameter 
is rewritten 



<5<— ((2,2)(3,3);2,4,4) (2.5.7) 
X <— > ("1/2 + vi, 1/2 + 1^1; -1 + z*>, z/ 2 , 1 + ^; 1/2, 1/2, 1/2, 3/2, 3/2). 
The explanation is as follows. For a partition (|2.3.3|) . 

l{0) = sp(ri) x so(r 2 ) x sp(r 3 ) x ... (2.5.8) 

and the centralizer in G is a product of Sp(r 2 j + i) and 0(r 2 j), i.e. Sp for the 
odd parts, O for the even parts. Thus the component group A(h,e), which 
by |BV2j also equals A(e), is a product of Z 2 , one for each r 2j - 7^ 0. Then 
A(x>&) = -A(z/, ft, e). In general Am bc (Xi&) — ^M sc (e) embeds canonically 
into ^4(x,e), but the two are not necesarily equal. In this case they are 
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unless one of the v \ = for an even a, with the additional property that 



as 



there is no 2xj = Oj. 

We can rewrite each of the remaining strings 

, Obi 1 Chrt X , , , 

+ + (2.5.9) 

Xi ■=(fi + Ti,fi + i + T i ,...,F i +n), (2.5.10) 

satisfying 

/iGZ + 1/2, 0<ri<l/2, F i = f i + a i ,. (2.5.11) 

\fi + n\ > \Fi + Ti\ if n = 1/2 

This is done as follows. We can immediately get an expression like (|2.5.10p 
with < Tj < 1, by defining to be the largest element in Z+l/2 less than or 
equal to + v^. If n < 1/2 we are done. Otherwise, use the Weyl group 

to change the signs of all entries of the string, and put them in increasing 
order. This replaces fi by — Fi — 1, and n by 1 — Tj. The presentation of the 
strings subject to (|2.5.1ip is unique except when n = 1/2. In this case the 
argument just given provides the presentation (fi + 1/2, . . . , F{ + 1/2), but 
also provides the presentation 

(-Fi - 1 + 1/2, . . . , -fi - 1 + 1/2). (2.5.12) 

We choose between (|2.5.10p and (|2.5. 12[) the one whose leftmost term is 
larger in absolute value. That is, we require |/j + Tj| > \Fi + Tj| whenever 
n = 1/2. 

2.6. G of Type C. Rearrange the parts of the partition of 
6 C so(2n + 1, C), in the form dO^]) . 

((ai, ai), . . . , (o fc , Ofc); 2x + 1, . . . , 2x 2m + 1); (2.6.1) 

The di have been relabeled as 2xi + 1. In this case it is automatic that 
there is an odd number of nonzero Xj. The X{ are integers, because all the 
even parts of the partition of O occur an even number of times, and were 
threrefore extracted as (aj, ai). The x °f the form h/2 + v are 

(. . . ; 2 +Ui,..., 1 +!/»;... ; O^^O, . . . , x 2m , ■ ^2m ). (2.6.2) 
where 

n, = ( m r i in = °' (2.6.3) 
\#{xi>l} if i t^O. 

Lemma [2.41 holds for this type verbatim. So the following proposition holds. 

Proposition. A parameter x = h/2 + v cannot he conjugated to one of the 
form h' /2 + v 1 for any larger nilpotent O' if and only if 

(1) the set of strings satisfying + — %2~~ — Vj £ Z are nested. 
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(2) the strings satisfying ^ h £ Z satisfy the additional condition 

that either x 2m + 1 < — + v% or there is j such that 

a,- — 1 ai — 1 , 

Xj + K — % —— + Vi <-L— + 1/i < Xj+1 . (2.6.4) 

The Levi component xxxkl is obtained from rn.BC as follows. Consider the 
strings for which a, is odd and z/j = 0. If en is not equal to any 2xj + 1, then 
remove one pair (oj, Oj), and add two 2xj + 1 = ai to the last part of (|2.6.ip . 
For example, if the nilpotent orbit is 

(1,1,1,3,3,4,4) = ((1,1),(3,3),(4,4);1), (2.6.5) 

then the parameters of the form h/2 + v are 

(i/!;-l + z/ 2 ,z/ 2 ,l + z/ 2 ; 

- 3/2 + u 3 , -1/2 + i/ 3 , 1/2 + ^3, 3/2 + i/ 3 ) 

The Levi component is ra.BC = 5^(1) x 9K^) x 5^(4)- ^ ^2 / 0, then msc = 
m,KL- But if 1/2 = 0, then v\kl = 5^(1) x S^(4) x £>(3)- The parameter is 
rewritten 

6 <— ((1,1), (4, 4); 1,3, 3) (2.6.7) 

X <— ► fa; -3/2 + 1*, -1/2 + ^3, 1/2 + ^3, 3/2 + ^ 3 ; 0, 1, 1). 

The Levi component xtxkl is unchanged if v\ = 0. 

The explanation is as follows. For a partition (|2.3,3p . 

3(0) = sofa) x sp(r 2 ) x sofa) x . . . (2.6.8) 

and the centralizer in G is a product of Ofaj+i) and Spfa^), i.e. O for the 
odd parts, Sp for the even parts. Thus the component group is a product of 
Z 2 , one for each r 2 j + i 7^ 0. Then A(x,e) = A(v,h,e), and so Am bc (x,&) 
A : \ . e) unless one of the ^ = for an odd with the additional property 
that there is no 2xj + 1 = aj. 

We can rewrite each of the remaining strings 

(-^y^ + ^,...,^^ + ^) (2.6.9) 

as 

Xi :=(/< + n, /i + 1 + r i5 . . . , Fi + n), (2.6.10) 
satisfying 

/<GZ, 0<Ti<l/2, F i = f l + a i (2.6.11) 

l/i + Til > fa + Ti| if T i = 1/2. 

This is done as follows. We can immediately get an expression like (12.6. 10p 
with < Tj < 1, by defining fi to be the largest element in Z less than or 
equal to _ ct »~ 1 -|_ ^. If Tj < 1 /2 we are done. Otherwise, use the Weyl group 
to change the signs of all entries of the string, and put them in increasing 
order. This replaces /, by — — 1, and t-i by 1 — Tj. The presentation of the 
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strings subject to (|2.6.11|) is unique except when n = 1/2. In this case the 
argument just given also provides the presentation 

(-Ft - 1 + 1/2, . . . , -fi - 1 + 1/2). (2.6.12) 

We choose between (12.6. 10p and (|2.6.12j) the one whose leftmost term is 
larger in absolute value. That is, we require |/j + Tj| > \Fi + Tj| whenever 

n = 1/2. 

2.7. G of Type D. Rearrange the parts of the partition of O C so(2n, C), 
in the form (|2~X4|) . 

((ai,oi), . . . , (a k ,a k );2x + 1, . . . ,2x 2m -i + 1) (2.7.1) 

The di have been relabeled as 2xi + 1. In this case it is automatic that there 
is an even number of nonzero 2xi + 1. The x% are integers, because all the 
even parts of the partition of O occur an even number of times, and were 
therefore extracted as (ctj, cij). The x °f the form h/2 + v are 

a i — 1 ctj — 1 

(. . . ; \- Vi, . . . , h I/jJ . . . ; 0, . . . , 0, . . . , X2m-1, ■ ■ ■ , X2m-l)- 




(2.7.2) 

where 

{m if Z = 0, , _ „ 

2.7.3) 
#{x t >l} if ^0. V ^ 

Lemma [2.41 holds for this type verbatim. So the following proposition holds. 

Proposition. A parameter x = n /2 + v cannot be conjugated to one of the 
form h' /2 + u' for any larger nilpotent O' if and only if 

(1) the set of strings satisfying ^rp- + v% — aj 2 — Vj E Z are nested. 

(2) f/ie strings satisfying + E Z satisfy the additional condition 
that either x 2 m-i + 1 < — 2i 2 — ^ + V{ or there is j such that 

a i — 1 — 1 ,„ _ 

Xj + K — ^— + i/i < + ^ < x,-+i. (2.7.4) 

The Levi component m^L is obtained from rn.BC as follows. Consider the 
strings for which a, is odd and v\ = 0. If Oj is not equal to any 2xj + 1, then 
remove one pair (a«, aj), and add two 2xj + 1 = Oj to the last part of (|2.7.ip . 
For example, if the nilpotent orbit is 

(1,1,3,3,4,4), (2.7.5) 

then the parameters of the form h/2 + v are 

(z/ i; -l + z/ 2 , u 2 ,l + u 2 ; 

- 3/2 + u 3 , -1/2 + i/ 3 , 1/2 + 1/3, 3/2 + 1/3) 

The Levi component is itibc — <?Kl) x S^(3) x <7^(4). If z> 2 / and u± ^ 0, 
then thee = ift^fL. If zv 2 = and i^i / 0, then tftxL = 0(3) x <?Z(1) x gl(4). 
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If U2 7^ and v\ = 0, then VIkl = fl^(3) x gl(A) x g(l). If v\ = v 2 = 0, then 
WKL = gl(^) x fl(4)- The parameter is rewritten 

6 ^((1,1), (4, 4); 3, 3) (2.7.7) 
X <— ► (vi; -3/2 + i/ 3 , -1/2 + ^3; 1/2 + u 3 , 3/2 + i*,; 0, 1, 1). 

The explanation is as follows. For a partition (I2.3.3|) . 

l{0) = so(ri) x sp(r 2 ) x so(r 3 ) x . . . (2.7.8) 

and the centralizer in G is a product of Ofaj+i) and Sp(r 2 j), i.e. O for the 
odd parts, Sp for the even parts. Thus the component group is a product of 
Z2, one for each r2j+i 7^ 0. Then A(x,e) = A(v,h,e), and so Ajvf sc (x>s) = 
^4(x, e) unless one of the v\ = for an odd at with the additional property 
that there is no 2xj + 1 = a,. 

We can rewrite each of the remaining strings 

(~ L 2- + ^,...,- L 2- + fi) (2-7.9) 

as 

Xi :=(/i + Tj, /i + 1 + Tj, . . . , Fi + Tj), 

satisfying fi G Z, < r, < 1/2, Fi = f { + a { 

\fi + n\ > \Fi + n\ if rj = 1/2. 

This is done as in types B and C, but see the remarks which have to do 
with the fact that —Id is not in the Weyl group. We can immediately 
get an expression like (|2.7.10p with < Tj < 1, by defining fi to be the 
largest element in Z less than or equal to — a '^~ 1 + V{. If Tj < 1/2 we are 
done. Otherwise, use the Weyl group to change the signs of all entries of 
the string, and put them in increasing order. This replaces fi by — Fi — 1, 
and Ti by 1 — Tj. The presentation of the strings subject to (|2.7.1ip is unique 
except when Ti = 1/2. In this case the argument just given also provides the 
presentation 

(-Fi - 1 + 1/2, ...,-fi- 1 + 1/2). (2.7.12) 

We choose between (I2.7.10P and (|2,7.12p the one whose leftmost term is 
larger in absolute value. That is, we require |/, + 7j| > \Fi + Tj| whenever 
Ti = 1/2. 
Remarks 

(1) A (real) spherical parameter \ is hermitian if and only if there is 
w € W(D n ) such that wx = — X- This is the case if the parameter 
has a coordinate equal to zero, or if none of the coordinates are 0, 
but then n must be even. 

(2) Assume the nilpotent orbit O is very even, i.e. all the parts of the 
partition are even (and therefore occur an even number of times). 
The nilpotent orbits labelled (I) and (II) are characterized by the 



(2.7.10) 
(2.7.11) 
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fact that rn.BC is of the form 

(-0 < — ► 9K a i) x • • • x 9 l i a k-i) x gl(a k ), 
(II) < — ► gl(a{) x • • • x gl{a k -{) x gl(a k )'. 

The last gl factors differ by which extremal root of the fork at the 
end of the diagram for D n is in the Levi component. The string for 
k is 

(-0 < — ► ( — + ffc 9 ■ ■ ■ , — — + Vk), 

tTT -, i a k — 1 a k — 3 a k — 1 

(^) < — ► ( — + Vk, ■ ■ ■ — — + Vk, g zyfc ' ) - 

We can put the parameter in the form ()2.7.10p and (12. 7. lip , because 
all strings are even length. In any case (I) and (II) are conjugate by 
the outer automorphism, and for unitarity it is enough to consider 
the case of (I). 

The assignment of a nilpotent orbit (I) or (II) to a parameter is 
unambiguous. If a x nas a coordinate equal to 0, it might be written 
as hi/2+vi or hjj/2+i/jj. But then it can also be written as h' /2+u' 
for a larger nilpotent orbit. For example, in type D2, the two cases 
are (2,2)/ and (2,2)//, and we can write 

(J) <— (1/2, -1/2) + (!/,!/), 
(J/) <__> (l/ 2) 1/2) + (!/,-!/). 

The two forms are not conjugate unless the parameter contains a 0. 
But then it has to be (1, 0) and this corresponds to (1,3), the larger 
principal nilpotent orbit. 
(3) Because we can only change an even number of signs using the Weyl 
group, we might not be able to change all the signs of a string. We 
can always do this if the parameter contains a coordinate equal to 
0, or if the length of the string is even. If there is an odd length 
string, and none of the coordinates of x are 0) changing all of the 
signs of the string cannot be achieved unless some other coordinate 
changes sign as well. However if x = h/2 + v cannot be made to 
satisfy (|2.7.10p and (|2.7.1ip . then x', the parameter obtained from 
X by applying the outer automorphism, can. Since L(x) an d L(x') 
are either both unitary of both nonunitary, it is enough to consider 
just the cases that can be made to satisfy (|2.7.10p and (|2.7.1ip . For 
example, the parameters 

(-1/3, 2/3, 5/3; -7/4, -3/4, 1/4), 

(-5/3,-2/3,l/3;-7/4,-3/4,l/4) 

in type Dq are of this kind. Both parameters are in a form satisfying 
(|2.7,10p but only the second one satisfies (|2.7.1ip . The first one 
cannot be conjugated by W(Dq) to one satisfying (|2.7.1ip . 
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2.8. Relation between infinitesimal characters and strings. In the 

previous sections we described for each nilpotent orbit O the parameters of 
the form h/2 + v with v G }{0) semisimple, along with condition (12. 3. 2ft . In 
this section we give algorithms to find the data (O, v) satisfying (|2.3.ip and 
(|2.3.2p . and the various Levi components from a \ G ft. The formulation was 
suggested by S. Sahi. Given a x £ o, we need to specify, 

(a) : strings, same as sequences of coordinates with increment 1, 

(b) : a partition, same as a nilpotent orbit O C g, 

(c) : the centralizer of a Lie triple corresponding to l{0), 

(d) : coordinates of the parameter v, coming from the decompositon 
X = h/2 + u, 

Furthermore, we give algorithms for 

(e) : two Levi components xhsc and v\kl-, 

(f) : another two Levi components rit e and m , 

(g) : one dimensional characters Xe and Xo of the Levi components m e 
and rh D . 

Parts (f ) and (g) are described in detail in section 15.31 These Levi compo- 
nents are used to compute multiplicities of relevant K— types in L(x)- 

Algorithms for (a) and (b). 

Step 0. 

G of type C. Double the number of O's and add one more. 
G of type D. Double the number of O's. If there are no coordinates equal to 
and the rank is odd, the parameter is not hermitian. If the rank is even, 
only an even number of sign changes are allowed in the subsequent steps. 

Step 1. 

G of type C,D. Extract maximal strings of the form (0, 1, . . . ). Each con- 
tributes a part in the partition of size 2(length of string)- 1 to O. 
G of type B. Extract maximal strings of type (1/2, 3/2, . . . ). Each contributes 
a part of size 2 (length) to O. 

Step 2. 

For all types, extract maximal strings from the remaining entries after 
Step 1, changing signs if necessary. Each string contributes two parts of size 
(length of string) to O. In type D, if the rank is odd and no coordinate of 
the original x 1S 0, the parameter is not hermitian. If there are no O's and 
the rank of type D is even, only an even number of sign changes is allowed. 
In this case, the last string might be (. . . ,b, —b — 1). If so, and all strings 
are of even size, O is very even, and is labelled II. If all strings are of the 
form (. . . , 6, b + 1), then the very even orbit is labelled /. 
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Algorithms for (c). 

G of type C,D. $(0) = so(mi) x sp{m2) x so(rri3) x . . . , where m; are the 
number of parts of O equal to i. 

G of type B. l{0) = sp(m\) x so{m2) ■ ■ ■ sp(ms) x . . . where again m, is 
the number of parts of O equal to i. 

Algorithms for (d). 

The parameter v is a vector of size equal to rkG. For each 3,, of 3(C), 
add rkjj coordinates each equal to the average of the string cooresponding 
to the size i part of O. For each factor jj, of $(0), the coordinates are the 
averages of the corresponding strings. The remaining coordinates of v are 
all zero. 

Algorithm for (e). 

The Levi subgroups are determined by specifying the GL factors. There 
is at most one other factor Gq^q) of the same type as the group. 

For rn.BC-, each pair of parts (k,k) yields a GL(k). If the correspond- 
ing string comes from Step 2, then the character on GL(k) is given by 
|det(*)| avera s cofstrin s. Otherwise it is the trivial character. The parts of 
the remaining partition have multiplicity 1 corresponding to a distinguished 
orbit in Qo(n ). 

For xxikl, apply the same procedure as for vxbci except for pairs coming 
from Step 1. If originally there was an odd number of parts, then there is no 
change. If there was an even number, leave behind one pair. The parts in 
the remaining partition have multiplicity 1 or 2 corresponding to an even 
orbit in Qo(n ). 

Algorithms for (f) and (g). 

Both m e and rh acquire a GL{k) factor for each pair of parts (k, k) in 
Step 2, with character given by the average of the corresponding string as 
before. 

For the parts coming from Step 1, write them in decreasing order a r > 
• • • > ai > 0. 

For rh e , there are additional GL factors 

G of type B: (a\ + a2)/2, (03 + a4)/2, . . . , (a r _2 + a r _i)/2 if r is odd, 
(ai)/2, (ci2 + a3)/2, . . . , (o r _2 +a r _i)/2 when r is even. The charac- 
ters are given by the averages of the strings (— (a r _i — 1)/2, . . . , (a r _2 — 
l)/2) and so on, and (— (a\ — l)/2, . . . , —1/2), . . . when r is even. 
Recall that the a, are all even because O is a nilpotent orbit in type 
C. 

G of type C: [a\ + «2)/2, («3 + 04) /2, . . . , with characters given by 
the averages of the strings (— {a\ — l)/2, . . . , (02 — l)/2), and so on. 
In this case O is type B, so there are an odd number of odd parts. 
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G of type D: (a± + a2)/2, (03 + a$)/2, . . . , with characters obtained 
by the same procedure as in type C. In this case O has an even 
number of odd parts. 

For m Q , there are additional GL factors 

G of type B: (a2 + as)/2, (a4 + as)/2, . . . , (a r _i +a r )/2 leaving a\ out 
if r is odd, (a\ + 02) /2, (03 + a^)/2, . . . , (a r _i + a r )/2 if r is even. 
The characters are given by the averages of the strings 
(— (a r — l)/2, . . . , (a r -i — l)/2) . . . and so on. 

G of type C: (02 + a-s)/2, (04 + as)/2, . . . , and characters given by 
the averages of the strings (—(03 — l)/2, . . . , (02 — l)/2), .... In this 
case O has an odd number of odd sized parts. 

G of type D: (ai+a2)/2, . . . , (a r _3 + a r _2)/2, ((a r _i— 1)/2) with char- 
acters obtained by the averages of the strings (—(02 — 1)/2, ■ ■ ■ , («i — 
l)/2), . . . , ((— a r -\ — l)/2, . . . , —1). In this case O has an even num- 
ber of odd sized parts. 

2.9. Let x = h/2 + v be associated to the orbit O. Recall from 12.31 

I M (x) ■■= Indg[L M (x)}, (2.9.1) 

where Lm{x) ls the irreducible spherical module of M with parameter x- 
Write the nilpotent orbit in (|2.3.4p with the (d\, . . . , d{) as in sections 12 .5M2. 71 
depending on the Lie algebra type. Then m^c = dK a i) x " ' " x dK a k) x 0o( n o) 
is as in (|2.3.5p . Thus x determines a spherical irreducible module 

Lm bc {x) = Li{xi) <8> ■ ■ ■ <8> L k {xk) ® Lq{xo), (2-9.2) 

with Xi = (— - + y ii ■ ■ ■ i + Ui )i while Xo — ho/2 for the nilpotent (di). 

Let m.KL be the Levi component attached to x = h/2 + v in sections 
I2.5H2.71 As for xhsc we have a parameter Lm kl {x)- m this case O = 
((a'u ai), • • • , (a' r , a' r ); d[, . . . d[) as described in l2.5tf277l Then (a W-conjugate 
of) x can be written as in (|2.5.2|) - (|2.T.2 j) ) . and 

m KL = gl(a[) x • • • x gl{a! r ) x jfoK), . 

^Mkl(x) = £l(Xl) ® • • • ® MXr) ® ^o(Xo)- 

Theorem. In i/ie p-adic case 

Im kl (x) = L(x)- 

Proof. This is in |BMlj . xxikl was defined in such a way that this result 
holds. □ 

Corollary. The module Im bc (x) equals L(x) ^ n the p—adic case if all the 
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3. The Main Result 

3.1. Recall that G is the (complex) dual group, and A C G the maximal 
torus dual to A. Assuming as we may that the parameter is real, a spherical 
irreducible representation corresponds to an orbit of a hyperbolic element 
X € &, the Lie algebra of A. In section [2] we attached a nilpotent orbit O in q 
with partition (oi, . . . a±, . . . , at, ■ ■ ■ , aj~) to such a parameter. Let {e, h, /} 

be a Lie triple attached to 6. Let x := h/2 + f satisfy (f2XT]) - (f2X2]) . 

Definition. ^4 representation L(x) is said to be in the complementary series 
for O, if the parameter x is attached to O in the sense of satisfying h2.3.1\) 
and \2. 3.2\) . and is unitary. 

We will describe the complementary series explicitly in coordinates. 
The centralizer Zq(c, h, f) has Lie algebra i(0) which is a product of 
sp(ri, C) or so(n, C), 1 < I < k, according to the rule 

G of type B, D: sp(ri) for a/ even, so(r;) for a\ odd, 
G of type C: sp{r\) for a\ odd, so{r\) for a; even. 

On %{y) , v determines a spherical irreducible module Lq{v) for the split 
group whose dual is Z<j(e,h,f)°. Applying (|2.3.1H2.3.2|) . we find that v is 
attached to the trivial orbit in liO). If it were not, then v = h! /2 + z/, for a 
triple {<=', h', /'}, with e' / 0, so x = (h/2+h' /2)+u' ', and {e+e' , /i+Zi', /+/'} 
is a Lie triple such that the orbit of e + e! is strictly larger than the orbit of 
e, and contains it in its closure. 

Theorem. The complementary series attached to O coincides with the one 
attached to the trivial orbit in i{0). For the trivial orbit (0) in each of the 
classical cases, the complementary series are 

G of type B: 

< v\ < • • • < u k < 1/2. 

G of type C, D: 

< v x < ■ ■ ■ < v k < 1/2 < u k+1 < ■ ■ ■ < u k+l < 1 
so that Vi + i>j ^ 1. There are 

(1) an even number of i>i such that 1 — Vk+i < v. L < 1/2, 

(2) for every 1 < j < I, there is an odd number of Vi such that 

1 - Vk+j+l < Vi < 1 — Vk+j- 

(3) In type D of odd rank, v\ = or else the parameter is not 
hermitian. 

Remarks. 

(1) The complementary series for O = (0) consists of representations 
which are both spherical and generic in the sense that they have 
Whittaker models. 
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(2) The condition that V{ + Vj ^ 1 implies that in types C,D there is at 
most one v\. = 1/2. 

(3) In the case of O ^ (0), \ = h/2 + v, and each of the coordinates Vi 
for the parameter on %(0) comes from a string, i.e. each z/j comes 
from (— ai 2 + v %i ■ ■ ■ j + ^i)- The parameter does not sat- 
isfy (|2,7.1ip . For (|2,7.1ip to hold, it suffices to change Vk+j f° r 
types C, D to 1 — z^fc+j. More precisely, for 1/2 < fk+j < 1 the 
connection with the strings in the form (|2.7.10p and (|2.7.1ip is as 
follows. Write {-^+fl + „ k+jj . . . , ^+fl + Vk+j ) as + 

{vk+j — 1) ? • • • i afc+ 2 +1 + (^fc+j ~~ 1)) anc ^ then conjugate each entry 
to its negative to form (_ afc +j 3 _|_ v' k+ j, . . . , afc+ 2 J+1 + v' k+ j), with 
< = 1 - v k+j < 1/2. 

An Algorithm. For types C and D we give an algorithm, due to S. Sahi, 
to decide whether a parameter in types C and D is unitary. This algorithm 
is for the complementary series for O = (0). For arbitrary O it applies to 
the parameter for i{0) obtained as in remark (3) above. 

Order the parameter in dominant form, 

< v\ < ■ ■ ■ < u n , for type C, 

< |i/i| < ■ ■ ■ < u n , for type D. (3.1.1) 

The first condition is that v n < 1, and in addition that if the type is D n with 
n odd, then i>\ = 0. Next replace each coordinate 1/2 < z/j by 1 — V{. Reorder 
the new coordinates in increasing order as in (|3.1.1j) . Let F{v) be the set of 
new positions of the 1 — fj. If any position is ambiguous, the parameter is 
not unitary, or is attached to a different nilpotent orbit. This corresponds 
to either a Vi + Uj = 1, or a 1/2 < z/j = Vj. Finally, L{v) is unitary if and 
only if F(v) consists of odd numbers only. 

3.2. We prove the unitarity of the parameters in the theorem for O = (0) 
for types B,C, and D. First we record some facts. 

Let G := GL(2a) and 

a — 1 a — 1 a — 1 a — 1 

X ■= ( ^ . . . , — u; — — ^— + v). (3.2.1) 

Let M := GL(a) x GL(a) C GL(2a). Then the two strings of x determine 
an irreducible spherical (1-dimensional) representation Lm{\) on M. Recall 
I M (x) ■= Ind%[L M (x)}- 

Lemma (1). The representation Im(x) ^ unitary irreducible for < v < 
1/2. The irreducible spherical module L(x) is not unitary for v > ^, 2v ^ Z. 

Proof. This is well known and goes back to [Steinj (see also pQ and [Vlj ) . □ 

We also recall the following well known result due to Kostant in the real 
case, Casselman in the p— adic case. 
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Lemma (2). If none of the (x,ct) for a £ A(g,d) is a nonzero integer, then 
X(x) is irreducible. In particular, if \ = 0, then 

L( X ) = X( X ) = Ind%[ X ], 

and it is unitary. 

Let m C g be a Levi component, and £t £ 3(m), where 3(m) is the center 
of rh, depending continuously on t £ [a, b] . 

Lemma (3). Let & be a character of M, depending continuously on t Gl, 
Assume that 

hi{xt) ■= Indjh[L M (r)o) ® 6] 
zs irreducible and hermitian for a < t < b. Then if Imixt) (equal to L(xt)) 
is unitary for some a < tQ < b, it is unitary for all a < t < b. 

This is well known, and amounts to the fact that if a hermitian matrix is 
nondegenerate and depends continuously on a parameter a < t < b, if it is 
positive definite for some a < to < b, it is positive definite throughout the 
interval; to change from positive to negative, it would have to go through a 
zero, i.e. become degenerate. This happens for example when Lm(i1o) ® Ct 
is unitary for some to, and Ihiixt) is irreducible. I don't know the original 
reference. 

When the conditions of lemma 3 are satisfied, we say that Iuixt) is a 
continuous deformation of L(xo)- 

We now start the proof of the unitarity. 

Type B. In this case there are no roots a £ A(g,d) such that (%, a) is a 
nonzero integer. Thus 

L( X ) = Ind G A [ X ] 

as well. When deforming x to continuously, the induced module stays 
irreducible. Since Ind^fO] is unitary, so is L(x)- 

Type C,D. There is no root such that {%, a) is a nonzero integer, so L(x) = 
Ind^lx]- If there are no fk+i > 1/2 the argument for type B carries over 
word for word. When there are Vk+i > 1/2 we have to be more careful 
with the deformation. We will do an induction on the rank. Suppose that 
fj-i = Vj for some j. Necessarily, Vj < 1/2. Conjugate x by the Weyl group 
so that 

X = (i>i, ■ ■ ■ , Vi, . . . upi, Vj,...,\ Vj-r, Vj) := (xo; Vj). (3.2.2) 

Let m := g(n — 2) x gl(2), and denote by M the corresponding Levi compo- 
nent. Then by induction in stages, 

L(x) = Ind G M [L M (x)l (3.2.3) 

where L M (x) = ^o(Xo) ® ^1(^-1, Vj). By lemma (1) of E21 L-i{vj-x,Vj) 
is unitary. Thus L(x) is unitary if and only if Lq(xo) is unitary. If x 
satisfies the assumptions of the theorem, then so does xo- By the induction 
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hypothesis, Lq(xo) is unitary, and therefore so is L(x)- Thus we may assume 
that 

< ui < ■ ■ ■ < u k < 1/2 < u k+1 < ■ ■ ■ < v k+l . (3.2.4) 

If v k < 1 — v k +i, then the assumptions imply 1 — < v k- Consider the 
parameter 

Xt :=(■■■ , fjfc, ^fc+i - t, . . . )■ (3.2.5) 

Then 

I(xt) = Induct], {ovO<t<u k+1 -v k , (3.2.6) 

because no (xt,Oi) is a nonzero integer. At t = v k +i — v k , the parameter is 
in the case just considered earlier. By induction we are done. 

If on the other hand 1 — v k +i < v ki the assumptions on the parameter are 
such that necessarily 1 — v k +\ < v k -\ < v k . Then repeat the argument with 

Xt ■= (...,u k -i,v k -t, ...), < t < v k - u k -x. (3.2.7) 

This completes the proof of the unitarity of the parameters in theorem 13.11 
when 6 = (0). 



3.3. We prove the unitarity of the parameters in theorem 13. II in the general 
case when O ^ (0). 

The proof is essentially the same as for O = (0), but special care is 
needed to justify the irreducibility of the modules. Recall the notation of 
the partition of O (|2X3l) . 

The factors of i{0) isomorphic to sp(rj), contribute rj/2 factors of the 
form gl(di) to xxikl- The factors of type so(rj) with rj odd, contribute a di 
(notation (I2.3.4p ) to the expression (|2.3.4p of the partition of O, and ~^2~ 
gl(a,i). The factors so{rj) of type D (r^ even) are more complicated. Write 
the strings coming from this factor as in (|2.3,6|) . 

, a% - 1 ai- 1 

( — +"*»••■.— g— + 

with the Vi satisfying the assumptions of theorem 13.11 If rj is not divisible 
by 4, then there must be a v\ = 0, (otherwise the corresponding spherical 
parameter is not hermitian), and xhsc / v^kl- Similarly when rj is divisible 
by 4 and v\ = 0, msc 7^ W-kl- In all situations, we consider 

Im k M (3-3.1) 

as for O = (0). We aim to show that this module stays irreducible under the 
deformations used for O = (0), separately for the for the same partition 
size or equivalently simple factor of l{0). It is enough to prove that under 
these deformations the strings stay strongly nested at all the values of the 
parameters. Then proposition 13.31 applies. 
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Using the conventions of section [2J the strings are of the form 



(—A — 1 + Ui, . . . , A - l + ui) 
{-B + v 2 ,...,B-l + v 2 ) 
(-C + v 3 ,...,C + v 3 ). 



(3.3.2) 
(3.3.3) 
(3.3.4) 



The Vi satisfy < u { < 1/2. When v x = 1/2, the string is (-A-1/2, ...,A- 
1/2) so it conforms to (12. 5. lip . (12.(1111) . (|2.7.11|) . Similarly when v 2 = 1/2, 
the string is (— B + 1/2, ... ,B — 1/2). But when v 3 = 1/2, the string is 
(-C+ 1/2, ..., (?+ 1/2 ) and it must be replaced by (-C- 1/2, . . . , C- 1/2) 
to conform to (|2. 5.111) . (|2.fl.lll) . (I2.7.1ip . The string in (|3X2j) gives a 
^13(0) = 1 — ^1 (as explained in remark (3) of section IBTTj) . The other ones 
v 2 and v 3 give za = v 2 or 1/3 respectively. Suppose first that there is 
only one size of string. This means that the corresponding entries v- 

belong to the same simple factor of l{0). Then the strings are either all of 
the form (13X2]) and (|3X4"1) with A = C or all of the form (13X31) . Consider 
the first case. If there is a string (|3.3.2j) then ^1^(0) = 1 — 1*1 > 1/2, and 
v \ 3(0) * s deformed downward. By the assumptions v l does not equal any 
u- nor does v 1 } ^ + u- } ^ = 1 for any j. The module stays irreducible. 
When v l ^ crosses 1/2, the string becomes (— A + f[, . . . , A + v^), and v\ is 
deformed downward from 1/2 to either some z/3 or to 0. Again v^ + v- ^ 1 
for any j, so no reducibility occurs. The irreduciblity in the case when v[ 
reaches is dealt with by section [TOl 

Remains to check that in these deformations no reducibility occurs be- 
cause the string interacts with one of a different length, in other words, when 
a ^3(0) for one size string or equivalently factor of %(0) becomes equal to 

a ^ 3 ((5) from a distinct factors of l{0). We explain the case when the de- 
formation involves a string of type (13. 3. 2p . the others are similar and easier. 
Consider the deformation of u\ from to 1/2. If the module is to become 
reducible v\ must reach a v 3 so that there is a string of the form (|3.3,4p 
satisfying 



This is the condition that the strings are not nested for some value of the 
parameter. This implies that A — 1<C<A+1 must hold. Thus A = C, 
and the two strings correspond to the same size partition or simple factor 



In the p-adic case, the irreducibility of (|3.3,ip in the case of strongly 
nested strings follows from the results of Kazhdan-Lusztig. In the case of 
real groups, the same irreducibility results hold, but are harder to prove. 
Given x, consider the root system 



A-K-C, 



A-KC. 



(3.3.5) 



in i{6). 



A x := {a G A : ( X ,a) G Z}. 



(3.3.6) 



Let G x be the connected split real group whose dual root system is A x . 
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The Kazhdan-Lusztig-Vogan conjectures for nonintegral infinitesimal char- 
acter relate statements about the character theory of admissible (g c , K)— modules 
of G with infinitesimal character x to similar statements for characters of ad- 
missible modules for G x but at integral infinitesimal character, for which the 
Kazhdan-Lusztig-Vogan conjectures for regular integral infinitesimal charac- 
ter can be used. This is beyond the scope of this paper (or my competence), 
I refer to |ABVj . chapters 16 and 17 for an explanation. 

In short, x determines an irreducible spherical representation and a 

spherical Lq (x). To prove the irreducibility results we need, we will prove 
them for Lq x (x)> where we may assume that the infinitesimal character is 
integral. Since G x is not simple, it is sufficient to prove the needed irre- 
ducibility result for each simple factor. This root system is a product of 
classical systems as follows. For each < r < 1/2 let A T be the set of 
coordinates of x congruent to r modulo Z. Each A T contributes to A x as 
follows. 

G of type B: Every < r < 1/2 contributes a type A of size equal 
to the number of coordinates in A T . Every r = 0, 1/2 contributes a 
type C of rank equal to the number of coordinates in A T . 

G of type C: Every < r < 1/2 contributes a type A as for type B. 
Every r = contributes a type B, while r = 1/2 contributes type 
D. 

G of type D: Every < r < 1/2 contributes a type A. Every r = 
0, 1/2 contributes a type D. 

The irreducibility results for lM KL (xt) needed to carry out the proof are 
contained in the following proposition. 

Proposition. Let 

, Oi - 1 Of - 1 , 

x-= (•••; 2 — VUh 2 — Vv ^---> 

be given in terms of strings, and let m = gl{a\) x • • • x gl(a/.) be the cor- 
responding Levi component. Assume that x is integral (i.e. (x, a) £ Z). In 
addition assume that the coordinates of x are 

• in Z, in type B, 

• in 1/2 + Z for type D. 

If the strings are strongly nested, then 

L( x ) = Ind%[L M { x )]. 

The proof of the proposition will be given in section [TUl Unlike in type 
B and D where (x, 6t) £ Z implies that the coordinates are integers or half 
integers, in type C, the condition implies that the coordinates are integers 
only. 

Remark. For the za- attached to factors of type D in i{0), it is important 
in the argument that we do not deform to (0). The next example illustrates 
why. 
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Assume 6 = (2, 2, 2, 2) C sp{A). The parameters of the form h/2 + v are 

(-1/2 + ui, 1/2 + ur, -1/2 + i/ 2 , 1/2 + u 2 ), (3.3.7) 

and, because parameters are up to W— conjugacy, we may restrict attention 
to the region < v\ < z/ 2 - In this case 3 (O) = so(4), and the unitarity region 
is < ±1^1 + ^2 < 1. Furthermore msc = 5^(2) x 5^(2), but m.KL = ^BC only 
if < v\. When v\ = 0, xtikl = sp(2) x gl(2), the nilpotent orbit is rewritten 
(2, 2; (2, 2)), and /io/2 = (1/2, 1/2). For v\ = 0, the induced representations 

hi KL (Xu 2 ) := /ndggj xGL(2) [L (l/2, 1/2)®L! (-1/2+^,1/2+^)] (3.3.8) 

are induced irreducible in the range < 1/2 < 1. For < v\ the representation 

^4l ( (4)[ L ((-V2+^i+M/2+^i+i); (-1/2-i/i-t, 1/2-^i-t))] (3.3.9) 

is induced irreducible for 0<i<l/2 — v\. 

The main point of the example is that Ind^^[L(— 1/2 + t, 1/2 + t)] 
is reducible at t = 0. So we cannot conclude that L{\) is unitary for 
a (^1,^2) with < v\ from the unitarity of L(x) f° r a parameter with 
v\ = 0. Instead we conclude that the representation is unitary in the region 
< ±^1 + V2 < 1 because it is a deformation of the irreducible module for 
z^i = V2 which is unitarily induced irreducible from a Stein complementary 
series on GL(4). □ 



4. Relevant ET-types 



In this chapter we define a special set of K— types (occuring in the spher- 
ical principal series) which we call relevant. Their first important property 
is that the intertwining operators used to compute the hermitian form are 
particularly simple. This is the property of petite. A more general notion 
was introduced and studied independently by Oda, |Oda| . In the notation 
of chapter [5] these operators only depend on the W— structure of V KnB . In 
this chapter we determine these Weyl group representations for the relevant 
K~ types. In chapter [6] we carry out the intertwining operator calculations 
in terms of the Weyl group representations. These calculations are used to 
obtain necessary conditions for unitarity in chapter [71 But in chapters [9] and 
[10] they also prove to be crucial for determining unitarity and irreducibility 
of certain modules needded to complete the determination of the unitary 
dual. 

4.1. In the real case we will call a K— type (/i, V) quasi-spherical if it 
occurs in the spherical principal series. In section U we will use the nota- 
tion M = K n B. By Frobenius reciprocity (/x, V) is quasi-spherical if and 
only if V KnB + 0. Because the Weyl group W(G, A) may be realized as 
Nk(A)/Zk(A), this Weyl group acts naturally on this space. 

The representations of W(A n _\) = S n are parametrized by partitions 
(a) := (ai, . . . , a^), at < Oj+i, of n, and we write cr((a)) for the corresponding 
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representation. The representations of W(B n ) = W(C n ) are parametrized 
as in |L1] by pairs of partitions, and we write as 

cr((ai,...,a r ), 6 S )), 

a% < a i+1 , bj < b j+ i, ^ai + ^bj = n. (4.1.1) 

Precisely the representation parametrized by (|4.1.ip is as follows. Let k = 
^aj, I = Ylbj- Recall that W = S n xZg. Let x be the character of Z?; which 
is trivial on the first k Z2's, sign on the last I. Its centralizer in S n is S^x Si. 
Let cr((a)) and cr((b)) be the representations of S^, Si corresponding to the 
partitions (a) and (b). Then let c((a), (£>), x) be the unique representation of 
(Sk x S 1 ;) >< Z% which is a multiple of x when restricted to Z%, and c(a) (8><t(6) 
when restricted to Sk x Si. The representation in (|4.1.1|) . is 

cj((a),(b))=Ind^ SkXSi)K ^ [a(a,b, X )}- (4.1.2) 

If (a) / (b), the representations cr((a),(6)) and a ((b), (a)) restrict to the 
same irreducible representation of W(D n ), which we denote again by the 
same symbol. When a = b, the restriction is a sum of two inequivalent 
representations which we denote cr((a), (a))i ! ij. Let Wr a -\j := S ai x • • • x S ar 
and W( a \u := S ai x • • • x S' ar , be the Weyl groups corresponding to the Levi 
components considered in Remark (2) in section T2.71 Then a((a),(a))i is 
characterized by the fact that its restriction to Wr a \j contains the trivial 
representation. Similarly a((a),(a))u is the one that contains the trivial 
representation of Wr a -\jj. 

4.2. Symplectic Groups. The group is Sp(n) and the maximal compact 
subgroup is U(n). The highest weight of a if -type will be written as fJ,(a±, . . . , a n ) 
with di > di+i and a, 6 Z, or 

MK\ • • • ,a^') := ( ai,... ,oi , . . . , a k , . . . ,a k ) . (4.2.1) 

when we want to emphasize the repetitions. We will repeatedly use the 
following restriction formula 

Lemma. The restriction of fi(ai, ■ ■ ■ ,a n ) to U(n — 1) x £7(1) is 

//(&!, • • • ,6 n -i) <S> m(6„), 
where the sum ranges over all possible a\ > &i > 02 > • • • > > a m 

= El<t<n a « ~~ El<3<n-1 fy- 

Definition. The representations \x e (n — r, r) := /i(2 r ,0 n ~ r ) and fi (k,n — 
k) := fi(l k ,0 n ~ 2k , —l k ) are called relevant. 

Proposition. The relevant K— types are quasispherical. The representation 
of W(C n ) on V M is 

fj, e (n - r, r) < > a[(n - r), (r)], 

Ho(k, n — k) < ► cr[(k, n — k), (0)], 
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The if-types fj,(O n r , (— 2) r ), dual to [i e (n — r,r) are also quasispherical, 
and could be used in the same way as fi e (n — r,r). 

Proof. We do an induction on n. When n = 1, the only relevant representa- 
tions of £7(1) are fx e (l, 0) = /x(0) and // e (0, 1) = (2), which correspond to the 
trivial and the sign representations of W(C\) = Z/2Z, respectively. Con- 
sider the case n = 2. There are four relevant representations of £7(2) with 
highest weights (2,0), (1,-1), (2,2) and (0,0). The first representation is 
the symmetric square of the standard representation, the second one is the 
adjoint representation and the fourth one is the trivial representation. The 
normalizer of A in K can be identified with the diagonal subgroup (±1, ±1) 
inside £7(1) x £7(1) C £7(2). The Weyl group is generated by the elements 



"i 0" 




"1 0" 




" 1 


1 


3 


i 


3 


-1 



(4.2.2) 



The restriction to £7(1) x £7(1) of the four representations of £7(2) is 
(2,0) — > (2) <g) (0) + (1) g> (1) + (0) g> (2), 
(1, -1) — > (1) ® (-1) + (0) ® (0) + (-1) ® (1), 
(2,2)— ► (2)® (2), (4.2.3) 
(0,0) — > (0)0(0). 

The space y M is the sum of all the weight spaces (p) ® (q) with both p 
and q even. For the last one, the representation of W on V is <r[(2), (0)]. 
The third one is 1-dimensional so V M is 1-dimensional; the Weyl group 
representation is <t((0), (2)). The second one has V M 1-dimensional and 
the Weyl group representation is <r((ll), (0)). For the first one, V M is 2- 
dimensional and the Weyl group representation is cr((l),(l)). These facts 
can be read off from explicit realizations of the representations. 

Assume that the claim is proved for n — 1. Choose a parabolic subgroup 
so that its Levi component is M' = Sp(n — 1) x GL(1) and M is contained 
in it. Let H = £7(n - 1) x £7(1) be such that M C M' n K C H. 

Suppose that fi is relevant. The cases when k = or r = are 1- 
dimensional and are straightforward. So we only consider k, r > 0. The 
K-type //(2 r ,0 n_r ) restricts to the sum of 

^(2 r ,0 n ^ r " 1 )®^(0) (4.2.4) 

/i(2 r - 1 ,l,0 n - r - 1 )®^(l) (4.2.5) 

fi(2 r ~ 1 ,0 n - r )® f i(2). (4.2.6) 

Of the representations appearing, only /i(2 r , n_r_1 ) (8) n{0) and 

[i(2 r ~ 1 , 1, o n_r_1 ) igi /i(2) are quasispherical. So the restriction of V M to 

W{C n ^) xW(d) is the sum of 

<7[(n-r-l),(r)]®<7[(l),(0)] (4.2.7) 
a[(n-r),(r-l)]®a[(0),(l)] (4.2.8) 
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The only irreducible representations of W{C n ) containing (I4.2.7P in their 
restrictions to W(C n -\) are 

a[(l,n-r -l),(r)} (4.2.9) 

a[(n-r),(r)]. (4.2.10) 

But the restriction of a[(l,n — r - 1), (r)] to W(C n -i) x W(C\) contains 
a[(l, n-r-1), (r-l)]®cr[(0), (1)], and this does not appear in ([Q77j) - (|PI5]) . 
Thus the representation of W(C n ) on V M for (|4.2.9|) must be (|4.2.5j) . and 
the claim is proved in this case. 

Consider the case /x(l fe ,0', — l fc ) for k > 0, 2k + I = n. The restriction of 
this K-type to U(n — 1) x U(l) is the sum of 

^(1*,0', -I* -1 ) <8> M- 1 ) (4.2.11) 

^(1*-!^ -1*)® M (1) (4.2.12) 

m , -l*" 1 ) <g) /x(0) (4.2.13) 

A«(l fc , 0' -1 , —1*) ® A*(0) (4.2.14) 

Of the representations appearing, only (|4.2. 13j) and (|4.2. 14|) are quasispher- 
ical. So the restriction of V M to W(C n -\) x W(C\) is the sum of 

ff [(*-l 1 fc + l) l (0)]®ff[(l),(0)] I (4.2.15) 
a[(k, k + l-1), (0)] ® a[(l), (0)]. (4.2.16) 

The representation (14.2. 16|) can only occur in the restriction to W(C n -\) x 
W{Ci) of <t[(1, fc, k + Z - 1), (0)] or a[(k, k + I), (0)]. If fc > 1, the first one 
contains a[(l,k — l,k + I — 1),(0)] in its restriction, which is not in the 
sum of (|4.2.15j) and (|4.2.16j) . If k = 1 then (|4.2.15j> can only occur in the 
restriction of cr[(0, Z + 2), (0)], or cr[(l, / + 1), (0)]. But F M cannot consist of 
cr[(0, Z + 2), (0)] alone, because (|4.2. 15|) does not occur in its restriction. If it 
consists of both a[(0,l + 2), (0)] and a[(l,l), (0)], then the restriction is too 
large. The claim is proved in this case. □ 

4.3. Orthogonal groups. Because we are dealing with the spherical case, 
we can use the groups 0(a, b), SO(a, b), or the connected component of the 
identity, SO e (a, b). The corresponding K's are 0(a) x 0(b), S(0(a) x 0(b)), 
and SO(a) x SO(b), respectively. We will use 0(a,b) for the calculation of 
relevant K- types. For SO(a), an irreducible representation will be identi- 
fied by its highest weight in coordinates, fJ,(xi, . . . ,X\ a / 2 ]), or if there are 
repetitions, ^(x™ 1 , . . . ,^ fe )- For 0(a) we use the parametrization of Weyl, 
| Weyl| . Embed O(a) C U(a) in the standard way. Then we denote by 
n(x\, . . . , Xk, 0^ a / 2 ^~ k ; e) the irreducible 0(a)— component generated by the 
highest weight of the representation 

fl( Xl , ...,X k , l(l-e)W2-fc) )0 »- fe -(l-e)(a/2-fc)) 

of U(a). In these formulas, e = ±, is often written as + for 1, and — for — 1. 
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4.4. We describe the relevant if -types for the orthogonal groups 0(a,a). 

Definition (even orthogonal groups). The relevant K— types for 0(a,a) 
Me ([a/2] - r, r) := //(O^ ; +) ® /i(2 r , Z ; +) (4.4.1) 
Ho(r, [a/2] - r) := fx(l r , l ;+)® fi(l r , l ; +). (4.4.2) 

where r + 1 = [a/2] . 

Proposition. The relevant K— types are quasispherical. The representation 
ofW(D a ) ofO(a,a) on V M is 

a[(r,a-r),(0)} <— /.(O^; +) (8) l ; +), (4.4.3) 

a[(a - Ar), (Ar)], <— ► /x(l fc , o'; +) ® M(l fe , 0'; +), (4.4.4) 
When I = 0, and a is even, 

a[(a/2,a/2),(0)] <— ► /i(0 a / 2 ) ® / u(2 a / 2 " 1 , ±2), (4.4.5) 

a[(a/2), (a/2)]j^ <— /i(l a/2 "\ ±1) ® MW 2 " 1 , ±1). (4.4.6) 

We will prove this together with the corresponding proposition for 0(a+l, a) 
in section 14.61 



4.5. We describe the relevant if -types for 0(a + 1, a) 

Definition (odd orthogonal groups). The relevant K -types for 0(a + 1, a) 

are 

a e (a - r, r) := ^(0^+^ ; +) ® a(2 r , l ; +) (4.5.1) 

fi (a - k, k) : = /i(l fc , 0'; +) ® /i(l fc , s ; +) (4.5.2) 

fi (k, a-k):= a(l k+1 , l ; +) ® /x(l fc , s ; +) (4.5.3) 

where r + l = [a/2] in gXT]), k + l = [(a + l)/2], fc + s = [a/2] in gX^), 
and fc + 1 + Z = [(a + l)/2], fc + s = [a/2] in gXgp . 

Proposition. TTie representations of W{B a ) on V M for the relevant It- 
types are 

a[(r,a-r),(0)] <— ^(O^ 1 )/ 2 ] ; +) ® /i(2 r , O'; +) (4.5.4) 

cr[(a — fc), (fc)] <— ^(l fc ,0[( a+1 )/ 2 ]- fc ;+)®^(l fc ,0[ a / 2 ^';+), (4.5.5) 

a[(k),(a-k)} <— ► ^(l fc+1 ,0[( a+1 )/ 2 ]-^ 1 ;+)®^(l fc ,0[ a / 2 ^ fc ;+). 

(4.5.6) 

When a is even, 

ff[(o/2), (a/2)] <— ► /J (l a / 2 )0^(l a / 2 - 1 ,±l). (4.5.7) 

When a is odd, 

«_> M1 ( ^ 1)/2 ,±1)®M1 ( ^ 1)/2 ). (4.5.8) 
The proof will be in section 14.61 
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4.6. Proof of propositions 14.41 and 14.51 We use the standard realization 
of the orthogonal groups 0(a + 1, a) and 0(a,a). Let 

M := {(r/ ,??i,...,7?o,ei,...,e a ) : r^, ej = ±1, JJ^ = JJey = 1}, (4.6.1) 

viewed as the subgroup of 0(a + 1) x 0(a) with the r/i, ej on the diagonal. 
With the appropriate choice of a = M a , M C ./V^ (a), and the action is 

(Vi^j) ■ (■■■,x k ,...) = (...,r] k e k x k ,...). (4.6.2) 

Then M := K f] B is the subgroup of M determined by the relations r/j = 
ej, j = 1, . . . , a. Similarly for 0(a) x 0(a) but there is no r/o- 

We do the case 0(a + 1, a), 0(a, a) is similar. The representations fi Q (a — 
k,k) and /j, (k,a — k) can be realized as f\ k C a+1 &) f\ k C a , respectively 
A fc+1 C a+1 <8> A k (C a ). Let a be a basis of C a+1 and ft a basis of C a . The 
space V is the span of the vectors A • • • A ei k <S> fi t A ■ ■ ■ A /j fe , and 
eo A A • • • A ei k ® f. tl A • • • A fi k . The elements of W corresponding to 
short root reflections all have representatives of the form 770 = — 1, % = — 1, 
the rest zero. The action of S a C W on the space V M is by permuting 
the ej, /j diagonally. Claims (14. 4. 4114.4.51) and (|4.5.5H4.5.6j) follow from these 
considerations, we omit further details. 

For cases (14. 4, 3ft and (I4.5.4|) we do an induction on r. We do the case 
0(a, a) only. The claim is clear for r = 0. Since the first factor of fi e ([a/2] — 
r,r) is the trivial representation, we only concern ourselves with the second 
factor. Consider /\ r C a <S>/\ r C a . The space of M— fixed vectors has dimension 
(") , and a basis is 

A ■ ■ ■ A e ir <g> e ix A • • • A e ir (4.6.3) 

As a module of S a , this is 

l<i<r 

On the other hand, the tensor product /\ r C r (8) A r consists of repre- 
sentations with highest weight n(2 a , l 13 , 7 ). From the explicit description 
of /\ k C a , and the action of M, we can infer that V M for (3 7^ is (0). 
This is because the representation occurs in /\ a+ ^C a <8)/\ a C a , which has no 
M— fixed vectors. But /i(2^ ,0 l ) for j < r occurs (for example by the P-R-V 
conjecture). By the induction hypothesis, (j,a — j) occurs in ^(2^,0 l ), for 
j < r, and so only (r, a — r) is unaccounted for. Thus V M for /x e ([a/2] — r, r) 
be (r, a — r). The claim now follows from the fact that the action of the short 
root reflections is trivial, and the description of the irreducible representa- 
tions of W(B a ). 

4.7. General linear groups. The maximal compact subgroup of GL(a,M) 
is 0(a), the Weyl group is W(A a _ 1 ) = S a and M ^ O(l) x • • • x 0(1). We 



list the case of the connected component GL(a,K) + (matrices with positive 
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determinant) instead, because its maximal compact group is K = SO (a) 
which is connected, and irreducible representations are parametrized by their 
highest weights. 

Definition. The relevant K— types are the ones with highest weights 

M2 fc ,o'). 

The corresponding Weyl group representations on V M are o~[(k,a — k)]. 

We omit the details, the proof is essentially the discussion about the 
representation of S a on f\ C a ig) f\ C a for the orthogonal groups. 

4.8. Relevant W— types. 

Definition. LetW be the Weyl group of type B,C,D. The following W — types 
will be called relevant. 

a e (n-r,r) := a[(n - r), (r)], a (k, n - k) := a[(k, n - k), (0)] (4.8.1) 

In type D for n even, and r = n/2 there are two W— types, 
a e [(n/2), (n/2)]jji := a[(n/2), (n/2)]jjj . If the root system is not simple, 
the relevant W— types are tensor products of relevant W— types on each fac- 
tor. 

5. Intertwining Operators 

5.1. The notation from chapter|3]is in effect. Recall that X(i>) denotes the 
spherical principal series. Let w £ W. Then there is an intertwining operator 

I(w, v) : X(v) — ► X{wv) (5.1.1) 

defined as follows. Recall B = HN is a Borel subgroup, and let a) be a 
representative of w. Realize X(u) on the space of K— finite functions 

{/ : G — ► C : f(gb) = X (b- l )5B{b)- l / 2 f{g)} n(g)f(x) := f{g- l x). 
life X(v), then 

I{w,v)f{g) ■= / f(gw n)dn. 

J N/NHwNw- 1 

These intertwining operators make sense in both the real and p— adic case. 
They have the properties that the integral converges for Re{u, a) >> 0, and 
I(w, v) has an analytic continuation for {Rev, a) > 0. 

If (/i, V) is a K— type, (K the maximal compact subgroup in the real case, 
G(TZ) in the p— adic case) then I(w, v) induces a map 

I v (w,u) : Rom K [V,X(u)] — ► Rom K [V, X{wv)}. (5.1.2) 

By Frobenius reciprocity, we get a map 

R v (w, v) : (V*) KnB — > (V*) KnB . (5.1.3) 
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In case (//, V) is trivial the spaces are 1-dimensional and Ry(w,v) is a 
scalar. We normalize I{w,v) so that this scalar is 1. The Rv{w,v) are 
meromorphic functions in u, and the I(w, u) have the following additional 
properties. 

(1) If w = s ai ■ ■ ■ s ak is a reduced decomposition (aj simple roots and 
s ai the corresponding root reflections) let £{w) := k. If w = w\ ■ w 2 
with £(w) = £{w\) + £{w2), then I(w, v) = I{w\,w 2 v) o /(u^? In 
particular, /(id, i/) factors into a product of intertwining operators 
Ij, one for each s aj . These operators are 

Ij : X(s aj+1 . . . s ak ■ v) — > X(s aj . . . s ak ■ v) (5.1.4) 

(2) Let P be a standard parabolic subgroup with levi component M so 
that A C M, and w G W{M,A). Because X(v) = lndp[X M (v)], we 
can induce the intertwining operator Im(w, v) : Xm{v) — ► Xm{wv) 
to form the induced intertwining operator 

Ind%[I M (w,v)] : X{y) = Ind%[X M (v)} — ► X(wv) = Ind%[X M (wu)), 

Then I(w, v) = Ind^Iuiw, v)\. 

(3) If Re(u, a) > for all positive roots a, then Ry(wo, v) has no poles, 
and the image of I(wo, v) (vjq G W is the long element) is L{y). 

(4) If —V is in the same Weyl group orbit as u, let w be the short- 
est element so that wv = —v. Then the hermitian dual of X(y) is 
X(u) h = X(wv). Let ( , }/j be the hermitian pairing between X{v) 
and X(w^). It follows that L(v) is hermitian with inner product 

{vi,v 2 ) := (v\,I(w, v)v 2 )h- 

For the remainder of the section we consider the real case only. 

Let a be a simple root and P a = M a N a be the standard parabolic sub- 
group so that the derived part of the Lie algebra M a is isomorphic to the 
sZ(2, R) generated by the root vectors E± a . We assume that 6E a = —E_ a , 
where 6 is the Cartan involution corresponding to K. Let D a = \J — l(E a — 
E_ a ) and s a = e v-inD a /2 jj ere Sa ^ we ac tually mean the representative 
in Nk(A) of the Weyl group reflection. Then s„ = m a is in K n B n M a . 
Since the square of any element in K C\B is in the center, and K(~)B normal- 
izes the the root vectors, Ad m(D a ) = ±D a . Grade V* = ®V* according 
to the absolute values of the eigenvalues of D a (which are integers). Then 
K H B preserves this grading and 

\KnB _ ST\ n/*\KnB 



{V* 



The map ip a : sl(2, 



determines a map 



determined by 



1 




E n 



00 



1 




f a : SL(2,R) — ► G 



E- a 



(5.1.5) 
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with image G a , a connected group with Lie algebra isomorphic to sl(2,~. 
Proposition. On (V£ m ) KnB , 

j Id if m = 0, 

Rv{s a ,u) = i 2,7+1- <i/,a> j d jf m ^n 

{ll0<j<m. 2j+l+<v,a> 1 * 

In particular, I(w, v) is an isomorphism unless (v, a) E 2Z + 1. 



Proof. The formula is well known for 5L(2,M). The second assertion follows 
from this and the listed properties of intertwining operators. □ 



Corollary. For relevant K— types the formula is 

Id on the +1 eigenspace of s a , 

> Id on the -1 eigenspace of s a . 



Rv(s a , v) 



y i+<v,&> 

When restricted to (y*^ KnB j the long intertwining operator is the product of 
the Ry(s a , *) corresponding to the reduced decomposition of wq and depends 
only on the Weyl group structure of (y*^ KnB . 

Proof. Relevant K— types have the property that the even eigenvalues of D a 
are 0, ±2 only. The element s a acts by 1 on the zero eigenspace of D a and 
by —1 on the ±2 eigenspace. The claim follows from this. □ 

5.2. We now show that the formulas in the previous section coincide with 
corresponding ones in the p— adic case. In the split p-adic case, spherical 
representations are a subset of representations with Z-fixed vectors, where I 
is an Iwahori subgroup. As explained in jB], the category of representations 
with I fixed vectors is equivalent to the category of finite dimensional repre- 
sentations of the Iwahori-Hecke algebra TC := TL(T\G/I). The equivalence 
is 

V — * V 1 . (5.2.1) 

The papers |BMlj and [BM2| show that the problem of the determination 
of the unitary dual of representations with I fixed vectors, is equivalent to 
the problem of the determination of the unitary irreducible representations 
of 7i with real infinitesimal character. In fact it is the affine graded Hecke 
algebras we will need to consider, and they are as follows. 

Let A := 5(d), and define the affine graded Hecke algebra to be HI := 
C[W] <8> A as a vector space, and usual algebra structure for C[W] and A. 

The generators of C[W] are denoted by t a corresponding to the simple 
reflections s a , while the generators of A are co £ a. Impose the additional 
relation 

u>t a = s a (uj)t a + <uj,a>, uj G d, (5.2.2) 

where t a is the element in C[W] corresponding to the simple root a. If X(x) 
is the standard (principal series) module determined by x> then 

X(x) Z = H<g)A<C x . (5.2.3) 
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The intertwining operator I(w, x) is a product of operators I ai according to 
a reduced decomposition of w = s ai s ak . If a is a simple root, 

r a ■= (t a a - 1) - - , I a : x <g) l x i-> xr a (g> l SaX . (5.2.4) 

The I(w, x) have the same properties as in the real case. The r a are 
multiplied on the right, so we can replace a with — (u, a) in the formulas. 
Furthermore, 

C[W] = v a ®v*. 

Since r a acts as multiplication on the right, it gives rise to an operator 

r a {s a ,u):V: ^V:. 

Theorem. The Ry{s a ,v) for the real case on relevant K— types coincide 
with the r a (s a , v) on the V* ^ (v*) KnB 

Proof. These operators act the same way: 

I Id on the + 1 eigenspace of s a , 

r a {So,,v) = < !_ {v&) . (5.2.5) 

[ I+ttv*) on — eigenspace oi s a - 

The assertion is now clear from corollary (|5.ip and formula (|5.2.2|) . □ 
Remarks. 

(1) The Hecke algebra for a p-adic group G is typically defined using the 
dual root system of the complex group G. For example the formu- 
las for r a in the literature, e.g. |BMlj - [BM3j . have roots instead of 
coroots. 

(2) The intertwining operator I a is coincides with the intertwining op- 
erators obtained by grading the one coming from the p-adic group 
SL(2) applied to X— fixed vectors. For more details on the properties 
of the intertwining operators in the affine graded Hecke algebra case, 
the reader may consult [BM3J and |BC2j section 2. 

5.3. The main point of section [5\2l is that for the real case, and a relevant 
K-type (V, fj,), the intertwining operator calculations coincide with the in- 
tertwining operator calculations for the affine graded Hecke algebra on the 
space V KnB . Thus we will deal with the Hecke algebra calculations exclu- 
sively, but the conclusions hold for both the real and p-adic case. Recall from 
section [2~3l that to each x we have associated a nilpotent orbit O, and Levi 
components rn.BC an d v^kl- These are special instances of the following situ- 
ation. Assume that O is written as in (|2.3.4p {i.e. ((ai, ai), • • • , (a/., a/.)', (di)) 
with 



of type B 
of type C 
of type D 



(di) all odd; they are relabelled (2xq + 1, . . . , 2x2m + 1), 

(di) all even; they are relabelled (2xo, . . . , 2x2 m ), 

(di) all odd; they are relabelled (2xq + 1, . . . , 2x2 m -i + l). 
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Similar to flZESD , let 

tn := gl(ai) x ■ ■ ■ X gl(a k ) X fl(n ), n = n-^ai. (5.3.1) 

We consider parameters of the form x = h/2 + v. 

Write xo for the parameter ft/2, and \i '■= + Vi, ■ ■ ■ , 9d f^ + Vi)- We 

focus on xo as a parameter on g( n o)- We attach two Levi components 

9e ■ 

B gl(x 2m -i + x 2m -2 + 1) x • • • x gl(x 1 + x + 1) x Q{x 2m ) 

C gl(x 2m -l + X2m-2) x • • • x gl(x\ + x ) x g(x 2m ) 

D gl(x 2m -i + x 2m _ 2 + 1) x • • • x gl(x 1 + x + 1) 

(5.3.2) 

0o : 

£ #Z(x 2m + x 2m -i + 1) x • • • x gl(x 2 + x\ + 1) X g(x ) 

C gZ(x 2m + aJ2m-i) x • • • x gl(x 2 + xi) x g(x ) 

D gl(x 2m - 3 + x 2m -4 + 1) x • • • x gl(x 2m - 2 ) x 5(x 2m -i + 1)- 

There are 1-dimensional representations £(Xe) and L(xo) such that the 
spherical irreducible representation L(xo) = X(xo) w hh infinitesimal char- 
acter xo is the spherical irreducible subquotient of X e := Indp e (L(x e )) and 
X Q := Indp o (L(xo)) respectively 

The parameters Xe an d Xo are written in terms of strings as follows: 

X e : 

B : ... (-x 2 i-i, x 2i - 2 ) . . . {-x 2m , . . . , -1) 

C: ... (-X2i-i + 1/2, . . . , x 2i _ 2 - 1/2) . . . (-x 2m + 1/2, . . . , -1/2) 

D : ... (-x 2 »-i, • • • ,x 2i _ 2 ) . . . 

(5.3.3) 

X : 

B : ... (-x 2i , x 2i -i) . . . (-x , • • • , -1) 

C: ... {-x 2i + 1/2, . . . , x 2l _i - 1/2) . . . (-x + 1/2, . . . , -1/2) (5.3.4) 
D : ... (-x 2i , . . . , x 2i _i) . . . (-x 2m _ 2 , . . . , -l)(-X2m-l + 1, • • • , 0) 

Theorem. For the Hecke algebra, p-adic groups, 

[a[(n- r),(r)] : X e ] = [a[(n - r), (r)} : L( X o)}, 
[a[(k,n-k),(0)} : X ] = [<r[(k, n — k), (0)] : L( X o)} 

hold. 

The proof is in section 16.91 

For a general parameter x = Xo + v i the strings defined in section [2] and 
the above construction define parabolic subgroups with Levi components 
gl{a\) x • • • x gl(ak) x g e and gl(a\) x • • • x gl{a r ) x g a , and corresponding 
L e (x) and L D (x)- We denote these induced modules by X e and X Q as well. 
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Corollary. The relations 

[a[(n-r),(r)] : X e ] = [a[(n - r), (r)] : L( X % 

[a[(k,n-k),(0)\ : X ] = [a[(k,n — k), (0)] : L( X )] 

hold in general. For real groups, in the notation of sections \4-2§4-4\ 

[He(r,n-r) : X e ] = [/x e (r,n - r) : L(x)}, 

[Ho(k,n-k) : X a ] = [[J, (k,n - k) : L( X )]. 

Proof. The results in section 15.21 show that the intertwining operators on 
a e (k, n—k) for the p— adic group equal the intertwining operators for /J, e (k, n— 
k) for the real group, and similarly for a Q and /j, . Thus the multiplici- 
ties of the a e /a Q in L(x) for the p— adic case equal the multiplicities of 
the corresponding fi e /fi in L(x) hi the real case. We do the p— adic case 
first. Recall theorem 12.91 which states that Im kl {x) = L(x)- The Levi sub- 
group Mkl is a product of GL factors, which we will denote Ma, with 
a factor G{n$). So for W— type multiplicities we can replace Im kl (x) by 
IndM A xG(n )[®t r i v ® -^(Xo)]- We explain the case of a e = a e (k, n — k), that 
of g being identical. By Frobenius reciprocity, 

Rom w [a e : L(x)} = Rom w [a e : Im kl {x)] (5.3.5) 

= Hom w(MA)xH/(G(no)) [fj e : triv®L( Xo )]. (5.3.6) 

Using the formulas for restrictions of representations for Weyl groups of 
classical types, it follows that 

dimHom w [(T e : L( X )} = ^ dim Hom^^^)) [a e (k' , n - k') : L(xo)] 

V 

(5.3.7) 

= ^dimHom W ( G ( no)) [ff e (fc',n - k') : X ejG(no) ], 
k' 

where the last step is theorem 15.31 Since X e = ^^ AX g( n(l )[®^(Xi) ® 
X e ,G(n ){xo)]i again by Frobenius reciprocity, one can show that this is also 
equal to dimHomyi/[ce : X e ]. This proves the claim for the p-adic case. 

In the real case the proof is complete once we observe that in all the 
steps for the p— adic case, the multiplicity of triv ® fi e (k',no — k') in the 
restriction of fi e (k,n — k) matches the multiplicity of triv ® a e (k' ,uq — k') 
in the restriction of o~ e (k,n — k). Similarly for fi Q and cr . 

□ 

6. HECKE ALGEBRA CALCULATIONS 

6.1. The proof of the results in 15.31 is by a computation of intertwining 
operators on the relevant K— types. It only depends on the W— type of 
V KnB , so we work in the setting of the Hecke algebra. The fact that we can 
deal exclusively with W— types, is a big advantage. In particular we do not 
have to worry about disconnectedness of Levi components. We will write 
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GL(k) for the Hecke algebra of type A and G(n) for the types B, C or D 
as the case may be. This is so as to emphasize that the results are about 
groups, real or p— adic. 

The intertwining operators will be decomposed into products of simpler 
operators induced from operators coming from maximal Levi subgroups. We 
introduce these first. 

Suppose M is a Levi component of the form 

GL(ai) x • • • x GL(a t ) x G(n ). (6.1.1) 

Let Xi be characters for GL(ai). We simplify the notation somewhat by 
writing 

Xi < — ► Oi) := (--^o h Ui > ■ ■ ■ '^2 Vv ^' (6.1.2) 

The parameter is antidominant, and so L(xi) occurs as a submodule of 
the principal series X{{vi)). The module is spherical 1-dimensional, and the 
action of a is 

Xi(u) = (u, C l - 1 +Ui,...,- at - 1 +i>i)), uj G a, (6.1.3) 

while W acts trivially. The trivial representation xo of G(tiq) corresponds 
to the string (—no + e, . . . , — 1 + e) where 

'0 H of type B, 

e:=<l/2, H of type C, (6.1.4) 

1, H of type D. 

We abbreviate this as {vq). Again L(xo) is the trivial representation, and 
because xo is antidominant, it appears as a submodule of the principal series 
-^(Xo)- We abbreviate 

Am (.•>;)...) :=Ind^ GL{a l )xG(n )\®Ki ( 3triv\. (6.1.5) 

The module Xm{- ■ ■ (^j) • • • ) is a submodule of the standard module A(x) 
with parameter corresponding to the strings 

X :=(... , - Q ' 2 1 + Ui,..., °' 2 1 + v h . . . , -n + e, . . . , -1 + e). (6.1.6) 

In the setting of the Hecke algebra, the induced modules (|6.1.5p is really 
A M (. . . (vi) . . . ) = M ®i M [(g) Xi ® triv]. 

Let Wi^+i G be the shortest Weyl group element which interchanges the 
strings (fj) and (fi+i) in u, and fixes all other coordinates. The intertwining 
operator I Wi : X{i>) — > X (wij+iv) restricts to an intertwining operator 

lM,i,i+i{---{vi){vi+i) ■■■) ■ 

X M (. . . {vi)(vi+l) ■■■) — ► X Wii+lM (. . . ...)■ 

This operator is induced from the same kind for GL(oj+aj + i) where Mj j+i = 
GL(a,i) x GL(a,i + i) C GL(a,i + Oj+i) is the Levi component of a maximal 
parabolic subgroup. 
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Let wi £ W be the shortest element which changes (vi) to {—vi), and fixes 
all other coordinates. It induces an intertwining operator 

Im,i(- ■ ■ (yi)(vo)) ■ X M {- ■ ■ fa), fa)) — X WlM (. . . (-*/,), fa))- (6.1.8) 

In this case, w\M = M, so we will not always include it in the notation. In 
type D, if no = 0, the last entry of the resulting string might have to stay 
— Sd ^- + v\ instead of — v\. This operator is induced from the same kind 
on G(ai + no) with M[ = GL(a{) x G(jiq) C G(ai + no) the Levi component 
of a maximal parabolic subgroup. 

Lemma. The operators lM,i,i+i an d Imi are meromorphic in Vi in both the 
real and p-adic case. 

(1) lM,i,i+i has poles only if + v\ — ai+ ^~ 1 — £ Z. // so, a pole 
only occurs if 

ai - 1 a i+ i - 1 ai - 1 Oj+i - 1 



+ ^i< 7, 7, \~Vi< \-Vi+l- 



2 2 2 2 

(2) Imj has a pole only if + i>\ = e(mod Z). In i/iai case, a pole 
only occurs if 

ai — 1 

Proof. We prove the assertion for lM,i,i+i, the other one is similar. The fact 
that the integrality condition is necessary is clear. For the second condition, 
it is sufficient to consider the case M = GL{a\) x GL(a 2 ) C GL{a\ + a 2 ). 
If the strings are strongly nested, then the operator cannot have any pole 
because Xm is irreducible. Remains to show there is no pole in the case 
when -2^1 + U2 < + ^1, and + v\ > + v 2 . Let 

M> := GL(^±^ + v 2 + u x ) x + v x - v 2 ) x GL(a 2 ), 

, . ai - 1 a 2 - 1 . 

Oi) = ( 5— + fl, ■ ■ ■ , 9 + ^2) 

, i\ ,a>2 — 1 ai — 1 . 

fa) = (^2~ + 1 + ^2, • • • , + fi) 

(l/g) = (i/ 2 ) = ( — + U 2 , . . . , 2 + 

Then XmI^i)^)) C XA//(fa)fa)fa)), anc ^ ^M,i,2 is the restriction of 
^ 2 , 3 M',i,2, (fa)fa)fa) J M',2,3(fa)fa)fa)) to X M- Because the strings 
fa) fa) are strongly nested, I W23 M',l,2 nas no P°i e ) an d ^M',2,3 has no pole 
because it is a restriction of operators coming from SX(2)'s which do not 
have poles. The claim follows. □ 

Let a be a W— type. We are interested in computing r a (w, . . . fa) . . . ), 
where w changes all the for 1 < i to — fj. The operator can be factored into 
a product of r a (wi t i + i, *) of the type (|6.1.7|) and r a (wi, *) of the type (|6.1.8|) . 



40 



DAN BARBASCH 



These operators are more tractable. Here's a more precise explanation. Let 
M be the Levi component 

GL(a\) x • • • x GL(ai + a i+1 ) x ... in case Q5X7D (6.1.10) 
x • • • x G(ai + no) in case (|6.1.8p (6.1.11) 

Since Xm is induced from the trivial W(M) module, 

Romw[a,X M ((vi))] = Homw(M)[v\w(M) '■ triv ® X Mi i+1 ((vi), {n+i)) ® *r««] 
in case (l6X7]l (6.1.12) 

Hom w [o-, = i?om W ( M) [o-|^( M ) : triv ® X Ml ((vi),(v ))] 

in case (l6X8]l (6.1.13) 

where Mj^+i = GL{a,i) x G ? L(aj+i) is a maximal Levi component of GL(ai + 
<2j + i) and M/ = GL{ai) x G(uq) is a maximal Levi component of G(a; + 
no). To compute the r a (wi t i + i, *) and r a (wi, *), it is enough to compute 
the corresponding r CTj for the cTj ocuring in the restriction a \w{M) i n the 
cases GL(a,i) x GL(ai+i) C GL(ai + aj+i) and GL{a{) x G(no) C G(a; + 
no). The restrictions of relevant W— types to Levi components consist of 
relevant W— types of the same kind, i.e. o~[(n — r), (r)] restricts to a sum of 
representations of the kind cr e , and cr[(k, n — k), (0)] restricts to a sum of a Q . 
Typically the multiplicities of the factors are 1. 
We also note that 

X M \w= Y. V °® (V:) W{M) . (6.1.14) 

So the r a (w,*) map {V*) w ^ to (y*) w( - wM l 

6.2. Maximal Levi components, summary of results. 

In the next sections we will compute the cases of Levi components of 
maximal parabolic subgroups. We summarize the results. A typical Levi 
component will be denoted GL{k) x G(n) C G(k + n). The type refers to 
the type of G(n), 

Theorem. Let e be as in 6.1.4\ 

Type A: The interwtining operator Im,i,2((^i)(^2)) restricted to a(m, k+ 
n — m) is multiplication by the scalar 

« w u TT ^¥ )~( 2 f 1 + ^ + l)+j 



(^ + ^)-(-^+^2-l)-i" 

(6.2.1) 

Type B: For a = cr e (m, k + n — m), 

r -<^— '«"» = EL i „ +1/2 + (¥ + „ ) _ j < 6 - 2 - 2 > 
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Type C: For a = a e (m, k + n — m), 

= (6 ' 2 ' 3) 

Type D: For a = o~ e (m, k + n — m), 

0<j<m-l v 2 / J 

For types 5, C £/ie formulas hold for n = as well. In type D when n = 0, 
i/jere are two cases GL(k) C G(k) and GL(k)' C G(n). The formula is the 
same for r CTe(n _ mim )((z/)) and r ae ( n _ mim ) ((*/)') : 

n fl^p} < 6 '"> 

0<i<m I 2 ^ ^ J 

For 2m = n £/iere are two representations with subscript I and II; the formula 
above is the same. 

For a = a (m, k + n — m) and type B, C and D, the scalar 
((^X^o)) equals 

(y _ Y)-(l-6)+j (-„ - e )-(-„ + 

</<Li (* + ¥)- (-» - e ) - i a - e ) - - ¥) - j 

In this case n > /or 0" o to occur in the induced module. 

6.3. GL(k) x GL(n) C GL(k + n). This is the case of if j+i with z < I. The 
module Im((^i), (^2)) induced from the characters corresponding to 

, k — 1 fe — 1 . , n — 1 n — 1 

( 2~ + ^' ' ' ' ' — + "i)> ( 2~ + • • • ' ""T" + U2) (6 ' 3 - 1) 

has the following Sk+n structure. Let s := min(fc, n) and write o~(m, k + n — 
m) for the module corresponding to the partition (m, k+n — m), < m < s. 
Then 

*m((^i), (Kz)) \w= <r(ro,fc + n-m). (6.3.2) 

0<m<s 

Lemma. For 1 < m < s, the intertwining operator -/m,i,2((^i)(^2)) re- 
stricted to a gives 

, , (^-^i)-(^i+^ 2 + l)+j 

r a{mj k+n-m){Vl,V2) = [[ k ^ ~l ~ 7- 

0<j<m-l (^l + — ) " ( — + ^ " 1) " 3 

Proof. The proof is an induction on k, n and m. We omit most details but 
give the general idea. Assume < m < s, the case m = s is simpler. Embed 
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X M ((vi), fa)) into X M >{{v'), (v"), M), where M' = GL(k - 1) x GL(1) x 
GL(n), corresponding to the strings 

k — 1 k — 3 k — 1 n — 1 n — 1 . 

( Y~ + Vu ' ' ' ' "2" + ^^2~ + Vl " ^ 2~ + ' ' • ' ~^2~ + V2 '' 

(6.3.3) 

The intertwining operator lM,\,i(yiiV2) is the restriction of 

hi',1,2^', "2, v") Im',2,z(v'] v" , v 2 ) (6.3.4) 

to Xm((^i)) (^2)) C Xy((z/), (z/"), (z-^))- By an induction on k + n we 
can assume that these operators are known. The W— type a(m, k + n — 
m) occurs with multiplicity 1 in Xm((^i), (^2)) an d with multiplicity 2 in 
Xm'{{v')-, {v"), (^2))- The restrictions are 

cr(m, k + n — m) \w{M') = t r i y ® <r(m — 1, n + 1 — m) + triv (£> a(m, n — m) 

(6.3.5) 

for Im',i,2 (6.3.6) 
cr(m, k + n- m) \ w(M') = f (1> re ) + f(0, n + 1) for /a/', 2,3 (6.3.7) 

The representation <r(m, k+n—m) has a realization as harmonic polynomials 
in 5(a) spanned by 

n (6.3.8) 

\<l<m 

where ji), . . . , (i k ,j k ) are rre pairs of integers satisfying 1 < ^, < /c+n, 
and ^ 7^ j'^. We apply the intertwining operator to the S k x S n — fixed vector 

e : = ^ x- [(ei-ejfe+i) x ••• x (e m -e k+m )}. (6.3.9) 

x£S k xS„ 

The intertwining operator Im> 2, 3; has a simple form on the vectors 

ei := ^ x • [(ei - e fc +i) x • • • x (e m - e fe+m )], in <r(0,n + 1) 

xes k ^ 1 xs n+1 

(6.3.10) 

e2 := ^ a: ■ [(ei - e k+ i) x • • • x (e m _i - e k+m -i){e k - e k + m )], in a(l, 

(6.3.11) 

which appear in (|6.3.7p . They are mapped into scalar multiples (given by 
the lemma) of the vectors e' l5 e 2 which are invariant under S k -\ x S n x Si, 
and transform according to triv (g) <t(0, re + 1) and triv <S> c(l, n). We choose 

e[ = ei, 

e' 2 -= ^2 x • [(ei - e fc ) x • • • x (e m ,_i - e fc+m --2)(efc+n - £fc+m-i)] 
ie5 t _ixS„xSi 

(6.3.12) 
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The intertwining operator Im' 1,2 has a simple form on the vectors invariant 
under Sk-i x S n x Si transforming according to a(m, k + n — m — 1) and 
a(m — 1, k + n — m). We can choose multiples of 

fi := (6.3.13) 

£ • [(ei - e fc ) x • • • x (e m _i - e fe+m _ 2 )(e m - e fe+m _i)], 

in cr(m — 1, k + n — m) 

h ■= (6.3.14) 
y a; • [(ei - e k ) x • • • x (e m _i - e fc+m _ 2 )- 

•(em H h Cfc-i+efc + efc+m H h £fc+n-i - (A; + n - 2m + l)e n )] 

in cr(m, k + n — m — 1) 

The fact that /i transforms according to aim, k + n — 1) follows from (|6.3.8|) . 
The fact that / 2 transforms according to a(m — 1, k + n) is slightly more 
complicated. The product n( e i _ € k) x • • • x (e 

m— l efc+m— 2) transforms 
according to aim — 1, m — 1) under S2m-2- The vector 

[e m H h ejfc_i + e fc + e fc+m H h e fc+n _i -{k + n-2m + l)e k+n ] 

is invariant under the Sfc+ n _2m-i acting on the coordinates 
e m , . . . efc, £fc+m) ■ ■ • j efc+n-i- Since <r(m, + n — m — 1) does not have such 
invariant vectors, the product inside the sum in (|6.3.14p must transform 
according to a(m — 1, k + n — m). The average under x in (|6.3.14p is nonzero. 
The operator Im',2,3 maps f\ and / 2 into multiples (using the induction 
hypothesis) of the vectors /{, f 2 which are the S n x Sk-i x S\ invariant 
vectors transforming according to a{m, k + n— 1) and aim — l,k + n — m). 
The composition Im',i,2 Im',2,3 maps e into a multiple of 

e' := ^2 o- • [(ei - £n+i) x • • • x (e m - e n+m )]. (6.3.15) 

<r£S„xS k 

The multiple is computable by using the induction hypothesis and the ex- 
pression of 

e in terms of e±, e 2 , 

e'i , e' 2 in terms of f\ , / 2 , and 

e' in terms of /{, / 2 . 
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For example for the case k = 1, we get the following formulas. 

e = n(ei H he*.) - A;(e fc+1 H h e fc+n ), 

ei = (n + l)(ei H h e fc _i) - (fc - l)(e ft H h e fc+n ), 

e2 = «e fc - (e fe+ i H h £fc+n), 

/i = n(ei H h e fc _i) - (fc - l)(e fc H h e fc+n _i), 

/2 = (ei H h efe-i) + (efc H h e fc+n _i) - (A; + n - l)e k+n , 

e' = -k(ei H h e n ) - n(e n+ i H h e k+n ), 

e 'i = (n + H H efc-i) - (& - l)(e fc H h e k+n ), 

e 2 = H h ejfc +n _i) + n(e fc+n ), 

f[ = -(k+ l)(ei H h e n ) + n(e n+ i H h e fc+n _i), 

/2 = («i H h e„) + (e n+ i H h e fc+n _i) - (fc + n - l)e fe+n . 



(6.3.16) 



Then 



k — 1 + n 

e = ei -e2, 

n + 1 n + 1 

e / _ + , + fc ~ 1 . 
1 k + n — 1 k + n — 1 ' 

/ _ 1 . " ^ 

e 2 " fc + n-l' 1 " fc + n-l /2 ' 
/ = ^ + ^ ,/ _ w , 
k + n-l Jl k + n-V 2 ' 



(6.3.17) 



□ 



6.4. GL(k) x G(n) C G(n + k). In the next sections we prove theorem 15.31 
in the case of a parabolic subgroup with Levi component GL{k) x G{n) for 
the induced module 

X M ((vi)(vo)) = Ind G M [L{xi) ® i(xo)]- (6.4.1) 

The notation is as in section 16.11 
The strings are 

(-^ + v, . . . , ^ +v){-n+ 1 + e, -1 + e). (6.4.2) 

Recall that e = when the Hecke algebra is type B, e = 1/2 for type C, 
and e = 1 for type D, and 

rvH : (V:) W ^ _^ (6 . 4 . 3) 

We will compute r tT (w\, (^)(^o)) by induction on fo. In this case the relevant 
W— types have multiplicity < 1 so r a is a scalar. 
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6.5. We start with the special case k = 1 when the maximal parabolic 
subgroup P has Levi component M = GL{\) x G(n) C G(n + 1). In type D 
we assume n > 1. Then 

X M \w= ff[(n + 1), (0)] + ff [(l,n),(0)] + (r[(n),(l)], (6.5.1) 

and all the VF— types occuring are relevant. In types B,C the operator r a (v) 
is the restriction to (y*) w ( M ^ of the product 

ri,2 o • • • o r„ jn+ i o r n+ i o r n , n+ i o • • • o n >2 (6.5.2) 

as an operator on V a . Here rjj is the r IJ (w,*) corresponding to the root 
€i — €j and r n+ \ is the r a corresponding to e n+ ± or 2e n+ i in types B and C. 
In type D, the operator is 

n,2 o • • • o r„ ;n+ i o f^Ti o • • • o n >2 (6.5.3) 

where r^i+i are as before, and r^n+i corresponds to e n + e n+ \. Since the 
multiplicities are 1, this is a scalar. 

Proposition. The scalar r a (wi, ((^)(z / o))) ^ 

a c (l, n) = ff [(n), (1)] a (l, n) = <r[(l, n), (0)] 



B 
C 
D 



n+l — v n+l—u 

rt+l+i/ n+l+u 

(6.5.4) 

1/2+n-v 1/2+n-v 1/2-u 

l/2+n+v 1/2+n+u " 1/2+1/ 

ra— ;/ re— 1/ 1— t/ 

ra+i/ n+v 1+1/ 

Proof. We do an induction on n. 

The reflection representation o~[(n), (1)] has dimension n + 1 and the usual 
basis {e^}. The VF(M)— fixed vector is e\. The representation <r[(l, n), (0)] 
has a basis e| — with the symmetric square action. The W(M)— fixed 
vector is e? - £(ef + • • • + e 2 n+1 ). 

The case n = for type C is clear; the intertwining operator is 1 on 
/i o (l,0) = iriv and on // e (0, 1) = sgra. We omit the details for type B. 

In type for n = 1, i.e. Z?2, the middle TV— type in (|6.5.1j) decomposes further 

<r[(2), (0)] + a[(l), (1)] 7 + <x[(l), (1)] 7J + a[(0), (2)]. (6.5.5) 

The representations c[(l), (1)]/,// are 1-dimensional with bases e\ ± £2- The 
result is straightforward in this case as well. 

We now do the induction step. We give details for type B. In the case 
er e (l,n), embed Xm in the induced module from the characters correspond- 
ing to 

(f)(-n)(-n + l,...,-l). (6.5.6) 

Write M' = GL{1) x GL(1) x G[n— 1) for the Levi component correspond- 
ing to these three strings. Then the intertwining operator / : Xa/((i / )(^o)) — 1 
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Xm((— v )iyo)) is the restriction of 

hi',i,2((-n), {-u)(v )) o I M >,2{(-n)(v){v )) o I M ',i,2^, (~n), (u )). (6.5.7) 
The r a have a corresponding decomposition 

{r a ) M ',l,2{{-v), (-n)(z/ )) o (r (T ) M / i2 ((-n)(i/)(z/o)) o {r a ) M ' ,i,2{{v){-n){v Q )). 

(6.5.8) 

We need the restrictions of fj, e (l,n) and fi (l,n) to W(M'). We have 

^CSfcj^K" " 1). (0)]] = *K» + 1). (0)1 + 2ff[(n), (1)] + 2a[(l,n), (0)] 
+ 2a[(l,n - 1), (1)] + ff [(n - 1), (2)] + <r[(n - 1), (1, 1)] + 
+ a[(2, n - 1), (0)] + a[(l, 1, n - 1), (0)], (a) 



JjSj (0)]] = a[(n + 1), (0)] + a[(n), (1)] + a[(l, n), (0)], (b) 

(6.5.9) 



W(S„+i) 
W(S n+ i) 



w). (°)i ® *)> (°)]] = * + !) 



+ a[(l,n),(0)] (c) 
(d) 



Thus fi e (l,n) occurs with multiplicity 2 in Xm>- The W(M') fixed vectors 
are the linear span of e\, €2- The intertwining operators iju', 1,2 an d Im',2 
are induced from maximal parabolic subgroups whose Levi components we 
label Mi and M2. Then ei + e 2 transforms like triv®triv under W(M±) and 
ei — €2 transforms like sgnt&triv. The vector e\ is fixed under W{B n ) (which 
corresponds to M2) and the vector e 2 is fixed under W{B n -\) and transforms 
like fj, (l,n) under W(B n ). The matrix r a is, according to (|6.5.8j) . 



1 v-n+V 

2+u—n 2-\-v— n 
u-n+1 1 

l+v—n+l 2+v-n 





n—v 
n+v . 



1 u+n ' 

l+u+n l+u+n 

u+n 1 

l+v+n 2+u+n 



(6.5.10) 



So the vector e\ is mapped into ^ 1+ ^ ei as claimed. For er (l, n) we apply 

the same method. In this case the operator Im',2 is the identity because in 
the representation fi (l,n) the element t n corresponding to the short simple 
root acts by 1. 

The calculation for type D is analogous, we sketch some details. We 
decompose the strings into 

(f)(-n + l,...,-l)(0), (6.5.11) 

and M' = GL(1) x GL(n - 1) x GL(1). Then 



/m,i(H(^o)) = 
lM>,iA(- n + !,■■■. -l)(-^)(0)) ° + !,■■■ 

^Af',l,2((i / )(-^+ !)■ 



(6.5.12) 

-l)W(0))o 
.,-l)(0)). 
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Type C: 



Type D: 



□ 

6.6. In this section we consider (|6.4.2p for k > 1, n > 1 and the W— types 
a e (m,n + k — m) for < m < k (notation as in definition 14. 8p . These are 
the W— types which occur in Xm, with M = GL(k) x G(n) C G(k + n). 

Proposition. The r a (wi, ((^(^o)) for cr = a e (m,n + k — m) are scalars. 
They equal 

Type B: 

nn+1/2- (-^- + u) - j 
-tA " — - 6.6.2) 

TT n-{-^± + v)-j 

o</<Li- + (¥ + -)-j 

Proof. The proof is by induction on k. The case k = 1 was done in section 
16.51 so we only need to do the induction step. For types B,C factor the 
intertwining operator as follows. Decompose the string 

((*0(^+")fa>)) : = - ' ^+")(^+")fa>)) (6.6.4) 

and let M' := GL(k - 1) x GL(1) x G(n), and M" = GL(1) x GL(fc - 1) x 
G(n). Thus 

fe — 1 

Jm,i = Im"M( 9 ^(VX^o)) 

%M, 2 ((^')(-^-^h))o (6-6.5) 

^, 2 ((^)(^ + ^)M) 

Im',i,2 an d -Tm',2 were computed earlier, while Im",2 is known by induction. 
Then 

cr e (m, n + k-m) \w(GL(k-i)xW(G(n+i)) = 

triv <g) [<J e (l, n) + <r e (0, n + 1) + . . . (6.6.6) 
cr e (m, n + k-m) \w(GL(k)xW(G(n+k-i)) = 

[(k) (g> irtu + (1, k - 1) <g) iHu] + . . . (6.6.7) 
cr e (m, n + k-m) \w(GL(l)xW(G(n+k-l)) = 

triv <8> \o' e {m — l,n + k — m) + a e (m, n + k — 1 — m)] + . . . (6.6.8) 

where . . . denote W— types which are not spherical for W(M), so do not 
matter for the computations. 
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The W— type a e (m,n + k — m) = f\ m a e (l,n + k — 1). It occurs with 
multiplicity 2 in Xm' for < m < min(fc, n) and multiplicity 1 for m = 
min(fc,n). We will write out an explicit basis for the invariant S\ x St~i x 
W(B n ) vectors. Formulas (16.6.2p - (|6.6.4j) then come down to a computation 
with 2x2 matrices as in the case k = 1. Let 

e '- = ^IT \T x " [ £ i A • • • A e m ]. (6.6.9) 

ml (k — my. ^-^ 



This is the Sk x W{B n ) fixed vector of a e (m,n + k — m). It decomposes 



as 



e = e + e 1 = f Q + h (6.6.10) 

where 



eo 





1 




m\(k 


- 1 - 


m)! 




1 




(m — 


1)!(* 


— m)\ 




1 




m\{k 


- 1 - 
1 


m)\ 

X' 



^ x • [ei A • • • A e m ], 



xe5fc_ix5i 



■ft = 7 iWz \7 X] ei A X • [t2 A ■ • • A i 

m — 1 ! (k — my. ^-^ 



Let also 



e'o = eg = 7 -— -r V x ■ [ei A • • • A e m ], 

(m — 1)'(k — mj! 



y x • [(-ei + e m+ i) A e 2 A • • • A e m+ i] 



Then 



k — m / m , m i m , 

eo = — — e o + je\, ei = T e °"T ei ' 

II £ , t II £ k ~ m f 

e = /o + /i, e 1 = fo h- 

m 



(6.6.11) 



e'i = Yj a; • [ei A ■ ■ ■ A e m _i A (e m - e fe )], (6.6.12) 

x£S k - 1 xS 1 



(6.6.13) 
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We now compute the action of the intertwining operators. The following 
relations hold: 

r f \ r ( ^ n + e-(^ + u) 
lM',2[e ) = e , Im\ 2{ei) = 77— j -ei, 

^Af',i2(e'o) = e'o, iM',i2(ei) = 2v + fc_ l 6 "' 

w fn _ tt n + C -(-¥+^)-J f ^ 6 - 14 ) 
J M",2Uo; - ; ; , fc _ 3 ; — : -Jo, 

r m TT n + e-{-^ + v)-j 

-*Af",2UlJ — 7T-^ : -Jl, 

where e = 1 in type B, e = 1/2 in type C, and e = in type D. Then 

n + e — f + i/) 

hi'M e o + e i) = e o H rrn 7 e i- (6.6.15) 

n + e + + u) 

Substituting the expressions of eo , e\ in terms of e , e' x , we get 

k-m m n + e-(^ +v) , m n + e-{^-+u) , 

— ; \- Hh e n + — 1 t^-. e-i . (6.6.16) 

L k kn + e + (^ + uy ° n + e + (i^I + l ,) J 1 v ' 

Applying Im,2 to this has the effect that e is sent to e'^ and the term in e' x 
is multiplied by 2 v+k-i an< ^ e 'i * s replaced by e'/. Substituting the formulas 
for eg and e'{ in terms of /o, /i, and applying Im" 2, we get the claim of the 
proposition. □ 

6.7. We now treat the case a = a (m, n + k — m). We assume n > or else 
these TV— types do not occur in the induced module Xm- 

Proposition. The r a {w\, {{v)(vq)) are scalar s. They equal 

(z,-^l)-(l-e)+j (- n -e)-{-v + ^)+j 

</<Li ("+¥)- (-» - e ) - j a - c) - - Y) - j 

Proof. The intertwining operator Im{ v ) decomposes in the same way as 
(|6.6.5p . Furthermore, a (m,n + k — m) = /\ m a Q (l, n-\- k— 1). The difference 
from the cases <r e is that while cr e (l, n-\-k — 1) is the reflection representation, 
and therefore realized as the natural action on ei, . . . e n+ fc, a (l,n + k — 1) 
occurs in 5 2 <r e (l, n + k — 1), generated by ef — e| with i / j. We can apply 
the same technique as for a e (m, n + k — m), and omit the details. □ 

GL(k) C G(k) in types B, C. The formulas in proposition 16.61 and 16.71 
hold with n = 0. The proof is the same, but because n = 0, (z^o) is not 
present. The operator Im',2 is an intertwining operator in SL(2) and there- 
fore simpler. 
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6.8. GL(k) C G(k) in type D. In this section we consider the maximal 
Levi components M := GL(k) C G(k) and M' := GL(k)' C G(k) for type 
D n . The parameter corresponds to the string (v) := (— ^i + f, . . . , ^- + u) 



f 



or (z/) := (-^fi + i/, . . . , 

fe even: The W^— structure of Xm((")) and X M /((z/)') is a e [(n — r), (r)] 
for < r < fe/2, and a e [(k/2), (fc/2)]/, or o- e [fc/2), (fc/2)]// respec- 
tively, with multiplicity 1. There are intertwining operators 

J M ((f)) : X M ((f)) — x M ((-f)), 

I M '(W) = X M ,((v)>) — X M ,((-f)')- ( ' ' } 

corresponding to the shortest Weyl group element changing ((f)) to 
((— f)). They determine scalars r a ((v)) and ^((f)'). 
fe odd: The W— structure in this case is a e [(n — r), (r)] with < r < 
[k/2] for both Xm and Xj,//, again with multiplicity 1. In this 
case there is a shortest Weyl group element which changes ((f)) 
to ((— f )'), and one which changes ((f)') to ((— f )). These elements 
give rise to intertwining operators 

/m(H) : * M ((f)) X M ,((-u)'), 
I MI ((u)):X M/ ((u)')^X M ((-u)). [ ' ' } 

Because the W— structure of Xm and Xm 1 is the same, and W— types 
occur with multiplicity 1, these intertwning operators define scalars 
r a (v) and 7v((f)'). 

Proposition. The scalars r a ((v)) and r a ((v)') are 

*V e [(n-r),(r)] ((")) = II Mt~uT? ( 6 ' 8 - 3 ) 

0<j<r ^ 2 ' J 

These numbers are the same for ((f)) and ((f)')j an( ^ representations with 
subscripts /, II i/zey depend only on r. 

6.9. Proof of theorem 15.31 We use the results in the previous sections to 
prove the theorem in general. We give the details in the case of the group 
of type B and TV— types a e . Thus the Hecke algebra is type C. There are 
no significant changes in the proof for the other cases. Recall the notation 
from section 12.31 Conjugate v the middle element for the nilpotent orbit 
with partition (2xq, ■ ■ ■ ,2x2 m ) so that it is dominant (i.e. the coordinates 
are in decreasing order), 

f = (x 2m ~ 1/2, ...,x 2m - 1/2, ...,x - 1/2, ...,x - 1/2, . . . , 1/2, . . . , 1/2) 

Then v is dominant, so X(y) has a unique irreducible quotient L(v). We 
factor the long intertwining operator so that 

X(f) -A* Xe (u ) X(-f), (6.9.1) 
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where X e was defined in section 15.31 The claim will follow if the decompo- 
sition has the property that the operator I\ is onto, and I 2 is into, when 
restricted to the a e isotypic component. 

Proof that Ii is onto. The operator I\ is a composition of several op- 
erators. First take the long intertwining operator induced from the Levi 
component GL(n), 

X(x 2m - 1/2, . . . , 1/2) — ► X(l/2, . . . , x 2m - 1/2), (6.9.2) 

corresponding to the shortest Weyl group element that permutes the en- 
tries of the parameter from decreasing order to increasing order. The im- 
age is the induced from the corresponding irreducible spherical module 
L(l/2, . . . ,X2m — 1/2) on GL(n). In turn this is induced irreducible from 
1-dimensional spherical characters on a GL(xq) x • • • x GL(x 2m ) Levi com- 
ponent corresponding to the strings 

(1/2,..., x -1/2)... (1/2,..., x 2m -1/2) 

or any permutation thereof. This is well known by results of Bernstein- 
Zelevinski in the p— adic case, |V1| for the real case. 
Compose with the intertwining operator 

X(. . . (1/2, ...,x 2m - 1/2)) — X(. . . (-x 2m + 1/2, • • • , -1/2)), (6.9.3) 

all other entries unchanged. This intertwining operator is induced from the 
standard long intertwining operator on G(x2 m ) which has image equal to 
the trivial representation. The image is an induced module from characters 
on GL(xo) x • • • x GL(x2m-i) x G(x2m)- Now compose with the intertwining 
operator 

X(. . . (1/2, . . . , X 2 m-1 ~ l/2)(-X2m + 1/2, • • • , -1/2)) (6.9.4) 
—►*(... (-X 2m -1 + 1/2, . . . , -l/2)(-X2m + 1/2, • • • , "1/2)) 

(again all other entries unchanged). This is lM,2m-i defined in (|6,1.8p . so its 
restriction of (|6.9.4p to the a e isotypic component is an isomorphism. Now 
compose this operator with the one corresponding to 

X(. . . (1/2, . . . , x 2m -2-l/2)(-X2m-i + 1/2, . . . , 1/2) . . . ) (6.9.5) 

— ► X(. . . (-X 2m _i + l/2, . . . , X 2m -2 ~ 1/2) . • • ) 

with all other entries unchanged. This is induced from 

GL(xq) x • • • x GL(x 2m -3) x GL(x 2m -2 + x 2m -i) x G(x 2m ) 

and the image is the representation induced from the character correspond- 
ing to the string 

{-X 2 m-1 ~ 1/2, • • • , -1/2, 1/2, . . . , X2m-2) On GL(x 2m _2 + X2m-\). 

Now compose further with the intertwining operator 

X{. . . {-X 2 m-l + 1/2, • • • , X 2m -2 ~ l/2)(-S2m " 1/2, • • • , "1/2)) (6.9.6) 

-> X((-X 2m ~l + 1/2, • • • , X 2m -2 ~ 1/2) . . . (-x 2m - 1/2, . . . , -1/2)) 
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from the representation induced from 

GL(x ) x • • • x GL(x2m-z) x GL(x 2m -2 + x 2m -i) x G(x 2m ) 
to the induced from 

GL(x 2m -2 + x 2m -\) x GL(x ) x • • • x GL(x 2m - 3 ) x G(x 2m ). 

By lemma 16. 3| this intertwining operator is an isomorphism on any a e 
isotypic component. In fact, because the strings are strongly nested, the 
irreducibility results for GL(n), 13.31 imply that the induced modules are 
isomorphic. 

We have constructed a composition of intertwining operators from the 
standard module X(v) where the coordinates of v are positive and in de- 
creasing order (i.e. dominant) to a module induced from 

GL(x 2m - 2 + x 2m -i) x GL(x Q ) x • • • x GL(x 2m - 3 ) x G(x 2m ) 

corresponding to the strings 

((-x 2m -i + 1/2, . . . , x 2m - 2 - l/2)(l/2, ...,x - 1/2), . . . 

. . . , (1/2, . . . , x 2m _ 3 - l/2)(-x 2m + 1/2, . . . , -1/2)) 

so that the restriction to any a e isotypic component is onto. We can repeat 
the procedure with x 2m _4, x 2m _ 3 and so on to get an intertwining operator 
from X(v) to the induced from 

GL(x 2m _i + x 2m _ 2 ) x • • • x GL(xi + x Q ) x G(x 2m ) 

corresponding to the strings 

((-2C2m-l + 1/2, • • • , X 2m -2 - 1/2) . . . (-Zi + 1/2, . . . , x - 1/2), 
(-x 2m + l/2,...,-l/2)). 

This is the operator I\, and it is onto on the u e {*) isotypic components. 

Proof that I 2 is into. We now deal with I 2 . Consider the group G(x\ + 
+ x 2m ) and the Levi component M = GL{x\ + xq) x G(x 2m ). Let M' be 
the Levi component 

M' := GL(x 2m -i +x 2m „ 2 ) x • • • x GL(x 3 + x 2 ) x GL(x\) x GL(x ) x G(x 2m ). 

(6.9.7) 

Then X e embeds in X M , (. . . (-xi + 1/2, 1/2) (1/2, . . . , x - 1/2) (-x 2m + 

1/2, . . . , — 1/2)). The intertwining operator Im' ,m+i which changes the string 
(xo — 1/2, . . . , 1/2) to (— xq + 1/2, ... , —1/2) is an isomorphism on the a e 
W— types, by the results in sections 16. 1116.61 Since the strings are strongly 
nested, the operators lM,i,i+l ar e all isomorphisms, so we can construct an 
intertwining operator to an induced module Xm"(v") where 

M" = GL{x\) x GL(x ) x GL(x 2m -i + x 2m _ 2 ) x • • • x G(x 2m ), 

v" = (-xx + 1/2, • • • - l/2)(-x + 1/2, . . . , -1/2) . . . ) (6.9.8) 
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which is an isomorphism on the a e isotypic components. Repeating this 
argument for x$, X2 up to x 2m -i, x 2m - 2 we get an intertwining operator 
from X e to an induced module X M cj,){y^) where 

M (3) := GL(xi) x GL(x ) x • • • x GL(x 2m -l) x GL{x 2m _ 2 ) x G(x 2m ) 

„(3) := + 1/2, . . . , l/2)(-x + 1/2, . . . , -1/2) . . . 

(-x 2m _i + 1/2, . . . , -l/2)(-x 2m _ 2 + 1/2, . . . , -l/2)(-x 2m + 1/2, . . . , -1/2). 

(6.9.9) 

which is an isomorphism on the a e isotypic components. Let 

M< 4 ' := GL( Xl ) x GL(x ) x • • • x GL(x 2m _i) x G(x 2m ) 

and let z/( 4 ) be the same as but the last string is viewed as giving a pa- 
rameter of a 1-dimensional representation on GL(x 2m ). Then C 
and X A/ (3)(zv( 3 )) is a submodule of X M (4)(u^). The induced module from 
M^ 4 ) to M^ 5 ) := GL(x 2m + • • • + xq) is irreducible because the strings are 
strongly nested on the GL factors. Thus the intertwining operator which 
takes to — v is an isomorphism on X M (a) (z^ 4 ^)- So the induced intertwin- 
ing operator to G is therefore injective and maps to X{—v). The composition 
of all these operators is I\, and is therefore injective on the a e -isotypic com- 
ponents. The proof is complete in this case. 

The case of a Q is similar, and we omit the details. 

7. Necessary conditions for unitarity 

7.1. We will need the following notions. 

Definition. We will say a spherical irreducible module L(x) is r-unitary 

if the form is positive on all the relevant W— types. Similarly, an induced 
module Im{x) := ^ n ^M[-^A/(x)] * s r-irreducible if all relevant W— types 
occur with the same multiplicity in Im(x) as ^ n L{x)- 

7.2. We recall (jHXIj) . 

' 1/2 G of type B, (H of type C) 

G of type C, (M of type B) 

1 GoftypeD. 

Definition. A string of the form (/ + u, . . . , F + v) with f,F G e + Z is 
called adapted, if it is 

of even length for G of type B, 

of odd length for G of types C,D. 
Otherwise we say the string is not adapted. 

We will consider the following case. Let O C Q correspond to the partition 

6 < — ► ((01,01), . . . (a r ,a r );dx, ...,di) (7.2.1) 

so that O meets the Levi component rh = gl(a\) x • • • x gl{a r ) x £)(no), with 
2no + [l — e] = di+- • -+di, where [x] is the integer part of x. The intersection 
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of O with each gl(a,i) is the principal nilpotent, and the intersection with 
g(no) is the even nilpotent orbit Oq with partition (d\, . . . ,di). Let 

Xi = (fi + Vi,---,Fi + Vi) } 1 <i<r, 

(7.2.2) 

Xo = ho/2, where ho is a neutral element for (d±, . . . ,di). 

and x be the parameter obtained by concatenating the Xi- Then L(x) is the 
spherical subquotient of 

Jnd&[(g) L(xi)®L( X o)] (7-2.3) 

l<i<r 

The next theorem gives necessary conditions for the unitarity of L(x)- 

Theorem. In types B, C, the nilpotent orbit Oq is arbitrary. In type D as- 
sume that either (Do ^ (0), or else that the rank is even. The representation 
L(x) is unitary only if 

(1) Any string that is not adapted can be written in the form 

(-E + t,...,E -1 + t) < t < 1/2, E = e(mod Z). (7.2.4) 

(2) Any string that is adapted can be written in the form 
(-E + t,...,E + t) < r < 1/2, E = e(mod Z), 

or (7.2.5) 
(-E -1 + t,...,E -1 + t) < r < 1/2, E = e(mod Z). 

This is simply the fact that the Vj satisfy < Vj < 1/2 or 1/2 < Uj < 1 
in theorem 13.11 The proof will be given in the next sections. It is by 
induction on the dimension of Q, the number of strings with coordinates in 
an A T (definition after (|3.3.6p ) with and by downward induction on 

the dimension of O. The unitarity of the representation when there are no 
coordinates in any A r with r 7^ is done in section [9l 

7.3. The proposition in this section is a restatement of theorem 17.21 for the 
case of a parameter of the form (|7.3.ip . It is the first case in the initial 
step of the induction proof of theorem 17.21 I have combined the two cases 
in (2) into a single string {—E + v, ... ,E + v) with < v < 1 by changing 
(-E - 1 + t, ... , E -1+t) into (-E + (1 - t), ...,E+ (1 - r)). This 
notation seemed more convenient for the case when there is a single such 
string present. 

Consider the representation L(x) corresponding to the strings 

(a + e + v,... , A + e + v)(-x + e, . . . ,-1 + e), \a\ < A, < v < 1, (7.3.1) 

where a, A G Z, and e is as in 17.21 This is the case when L(x) is the 
spherical subquotient of an induced from a character on a maximal parabolic 
subalgebra of the form gl(A — a + 1) x g(xo). The second string may not be 
present; these are the cases xq = —1 for g of type B, D, xq = for type C. 
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Proposition. In type D, assume that if there is no string (— xq + €, . . . , — 1 + 
e), then A — a + 1 is even. Let L(x) correspond to ([7. 3. Then L{x) is 
r-unitary if and only if a + e = —A — e, and the following hold. 

(1) Assume that (a + e + v, . . . , A + e + v) is adapted. If xq = A — a + 1, 
then < v < 1, otherwise v = 0. 

(2) If (a + e + v, . . . , A + e + v) is not adapted, then < v < 1/2. 

Proof. This is a corollary of the formulas in section HT3l □ 

7.4. Initial Step. We do the case when there is a single A T with < 
r < 1/2, and the coordinates form a single string. We write the string 
as in (iTXTj) . (a + e + u, . . . , A + e + v) with < v < 1. We let 6 be 
the nilpotent orbit with partition {{A — a + 1, A — a + 1); d±, . . . , dj). Let 
m := gl(A — a + 1) Xf)(no), an d let C>o be the intersection of O with g(no). In 
type D, either Oq ^ (0) or else A — a + 1 is even. The statement of theorem 
17.21 is equivalent to the following proposition. 

Proposition. Assume Oq is even, and x is attached to O. Then L(x) i- s 
r-unitary only if a + e = —A — e, and the following hold. 

(1) If (a + e + u, . . . , A + e + v) is adapted, then u = 0, unless there is 
dj = A — a + 1, in which case < v < 1. 

(2) If {a + e + v % . . . , A + e + v) is not adapted, then < v < 1/2. 

Proof. We do the case of G of type C only, the others are similar. So e = 0, 
and adapted means the length of the string is odd, not adapted means the 
length of the string is even. The nilpotent orbit Oq corresponds to the 
partition (2xo + 1, . . . , 2x2 m + 1) an d the parameter has strings 

(l,...x )(0,l,...,a;i)...(l,...,a;2m)- 

The partition of O is (A — a + 1, A — a + 1, 2xq + 1, . . . , 2x2m + !)• 

We want to show that if A + a > 0, or if A + a = and there is no 
Xi = A, then L(x) is n °t r-unitary. We do an upward induction on the rank 
of Q and a downward induction on the dimension of 0. In the argument 
below with deformations of strings, we use implicitly the irreducibility results 
from section l2~6l So the first case is when is maximal, i.e. the principal 
nilpotent (m = 0). The claim follows from proposition 17.31 So we assume 
that m is strictly greater than 0. 

Assume X2i < A < X2i+i for some i. This case includes the possibility 
x 2m < A. We will show by induction on rank of g and dimension of 
that the form is negative on a VK-type of the form cr[(n — r), (r)]. So we use 
the module X e (notation as in I5.3H . If there is any pair X2j = %2j+ii the 
module X e is unitarily induced from GL(2x2j + 1) x G(n — 2x2j — 1) and all 
W— types a[(n — r), (r)] have the same multiplicity in L(x) as in X e . We can 
remove the string corresponding to (x2jX2j+i) in X e as explained in section 
13.21 lemma (3). By induction on rank we are done. Similarly we can remove 
any pair (x2j,X2j+i) such that either X2j+i < \a\ or A < X2j as follows. Let 
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M := GL(x2j + %2j+i + 1) x G{n — xij — X2j+i — 1). There is xm such that 
L(x) is the spherical subquotient of 

Ind,M[L(-X2j+i, . . -,x 2 j) ® L(xm)]- (7-4.1) 

Precisely, xm is obtained from x by removing the entries 
(1, . . . ,x 2 j), (0, 1, . . . ,x 2 j+i). Write 

Xt ■■= (~X2j+i + t, . . . , x 2 j + t; xm)- (7.4.2) 

The induced module 

X e ( Xt ) := Ind M [L{-x 2j+ i + t, . . . , x 2j + 1) ® L(xw)]. (7.4.3) 

has L(xt) as its irreducible spherical subquotient. For < t < X2j+1 2 X2j ; 
the multiplicities of cr[{n — r, r)] in L(xt) and X e (xt) coincide. Thus the 
signatures on the cr[{n — r),(r)] in L(xt) are constant for t in the above 
interval. At t = £2i±l_E2i ) X e (xt) is unitarily induced from triv (g> X' e on 
GL(x2j + a^2j+i + 1) x G(n — X2j — X2j+i — 1) and we can remove the string 
corresponding to (x2jX2j+i)- The induction hypothesis applies to X' e . 

When A + a = 0, by the above argument, we are reduced to the case 

O < — ► (2x + l,2xi + l,2x 2 + 1), x <A<xi<x 2 . (7.4.4) 

We reduce to (|7.4.4p when A + a > as well. We assume 2m = 2i + 2, 
since pairs (x2j, X2j+i) with ^4 < X2j can be removed. Suppose there is a 
pair (x2j,x 2 j+i) such that \a\ < X2j+i, and j ^ i. The assumption is that 

X2i < A < X2i+l so X 2 j + 1 < X 2 j < A. 

We consider the deformation xt in (|7.4.2p with 

< t < v, a < 0, 
-v < t < 0, a > 0. 

In either case X e (xt) = -^e(x), so the multiplicities of the a[(n — r), (r)] do 
not change until t reaches v in the first case, — v in the second case. If the 
signature on some o~[(n — r), (r)] isotypic component is positive semidefinite 
on -L(x), the same has to hold when t = v or — v respectively. The corre- 
sponding nilpotent orbit for this parameter is strictly larger, but it has two 
strings with coordinates which are not integers (so the induction hypothesis 
does not apply yet). For example, if a < 0, the strings for X e (xu) are (aside 
from the ones that were unchanged) 

(—x 2 j + i + v,...,A + v), (a + u,...,X2j + u). (7.4.5) 

We can deform the parameter further by replacing the second string by 
(a + v — t', . . . , X2j +v — t') with < t 7 < v. The strings of the corresponding 
X e do not change until t' reaches v. At t' = u the corresponding nilpotent 
orbit O' has partition 

(. . . , 2\a\ + 1, . . . , 2x2^^ + 1, ■ ■ ■ , A + x 2 j+i + 1,A + x 2j+ i + 1, . . . ) (7.4.6) 



UNITARY SPHERICAL SPECTRUM FOR SPLIT CLASSICAL GROUPS 



57 



which contains 6 in its closure. Since x 2 j+i < A, the induction hypothesis 
applies. The form is indefinite on a W— type cr[(n — r), (r)], so this holds for 
the original x as well. 

We have reduced to case (|7.4.4p . i.e. the partition of Oq has just three 
terms (2xo + 1, 2x\ + 1, 2x2 + 1)- We now reduce further to the case 

Oo < — ► (2x + 1), £o < A. (7.4.7) 

which is the initial step. 

Let I(t) be the induced module coresponding to the strings 

(-x 2 + t,...,x 1 +t)(a + v,...,A + i/)(-a? 0) •••,-!)• (7.4.8) 

i.e. induced from 

GL{x\ + x 2 ) x GL(-a + A + 1) x G(x ). (7.4.9) 

Consider the irreducible spherical module for the last two strings in (|7.4.8|) . 
inside the induced module from the Levi component GL{—a + A + 1) x 
G(xo) C G(— a + A + 1 + xo). By section [7TTI the form is negative on a[(xQ — 
a + A), (1)] if xo < a, negative on <r[(A), (xq + 1 — a)] if a < xq. In the second 
case the form is positive on all a[(A+r), (xq + 1 — a— r)] for 1 < r < xq + 1 — a. 
So let ?*o := 1 or xq + 1 — a depending on these two cases. The multiplicity 
formulas from section [631 imply that 

H(n-ro), (r„)] : I(t)] = [a[(n-r ), (r )\ : L( X )\ for < t < El^El. 

Thus signatures do not change when we deform t to X2 ~ Xl ; where I(t) is 
unitarily induced. We conclude that the form on L(x) is negative on a[(n — 

Assume X2i-i < A < X2i- In this case we can do the same arguments using 
X Q and a[(k,n — k), (0)]. We omit the details. □ 

7.5. Induction step. The case when the parameter has a single string with 
coordinates in an A r with < r < 1/2 was done in section [7.4i So we 
assume there is more than one string. Again we do the case G of type C, 
and omit the details for the other ones. 
Write the two strings as in (j2.6l) . 

(e + Ti,...,£? + Ti), (/ + r 2 ,...,F + r 2 ). (7.5.1) 

where < n < 1/2 and < r 2 < 1/2. Recall that because we are in type 
C, e,E,f,F £ Z, and e = 0. 

We need to show that ifF + />0orF + /<- 2 when F + / is 
even, or F + f < —1 when F + / is odd, then the form is negative on 
a relevant W— type. Because t\,t 2 > 0, and since r-reducibility and r- 
unitarity are not affected by small deformations, we may as well assume 
that (/ + r 2 , . . . , F + t 2 ) is the only string with coordinates in A T2 , and 
(e + ti, . . . , E + ri) the only one with coordinates in A T1 . 
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The strategy is as follows. Assume that L(x) is r- unitary. We deform 
(one of the strings of) x to a \t m such a way that the coresponding in- 
duced module is r-irreducible over a finite interval, but is no longer so at the 
endpoint, say to- Because of the continuity in t, the module L(xt ) is still 
r-unitary. The deformation is such that L(xt ) belongs to a larger nilpotent 
orbit than L(x), so the induction hypothesis applies, and we get a contra- 
diction. Sometimes we have to repeat the procedure before we arrive at a 
contradiction. 

So replace the first string by 

(e + Ti+t,...,E + n + t). (7.5.2) 

If x = (e + ti, . . . E + n ; xm), then 

Xt = (e + 7i + 1, . . . ,E + 71 + t; xm), 

X(xt) ~ Irufa[L(e + T 1 +t,...,E + T 1 + t)®L(xM)], 

where the Lie algebra of M is fkm = gl{E — e + 1) x g(n — E + e — 1) (so 
m = gl(E — e + 1) x g(n — E + e — 1)). 

If E < |e|, we deform t in the negative direction, otherwise in the positive 
direction. If f + t\ reaches or 1/2, before the nilpotent orbit changes, 
we should rewrite the string to conform to the conventions (|2.6.10p and 
(|2.6.1ip . This means that we rewrite the string as (e! + r{, ...,£" + r{) with 
< t[ < 1/2, and continue the deformation with a t going in the direction 
t < if E' < \e'\, and t > if E' > \e'\. This is not essential for the 
argument. We may as well assume that the following cases occur. 

(1) The nilpotent orbit changes at to = — T i- 

(2) the nilpotent orbit does not change, and at to = —71, 

either e, E > X2 m + 1 or — e, — E > X2 m + 1- This is the easy case 
when t can be deformed to oo without any r-reducibility occuring. 

(3) The nilpotent orbit changes at a to such that < t\ + to < 1/2. 

In the first case, the induction hypothesis applies, and since the string (/ + 
72, . . . , F + 72) is unaffected, we conclude that the signature is negative on 
a relevant W— type. In the second case we can deform the string so that 
either e + n + t = X2m + loiE + ri+t = —x^m — 1- The induction 
hypothesis applies, and the form is negative definite on a VF-relevant type. 
In the third case, the only way the nilpotent orbit can change is if the string 
(e + 71 + toj • • • > E + 71 + to) can be combined with another string to form 
a strictly longer string. If t\ + to ^ T2, the induction hypothesis applies, 
and since the string (/ + 72, ■ ■ ■ , F + 72) is unaffected, the form is negative 
on a relevant W— type. If the nilpotent does not change at t = t% — t\, 
continue the deformation in the same direction. Eventually either (1) or (2) 
are satisfied, or else we are in case (3), and the strings in (17.5. lj) combine to 
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give a larger nilpotent. There are four cases: 

(1) e< f <E<F, e< f <E <F 

(2) f < e < F < E, f < e < F < E 

(3) e<E = f-KF, (7 ' 5 - 3) 

(4) / < F = e - 1< E. 

Assume |e| < E. Then t is deformed in the positive direction so t\ < 
t~2- If e < 0, we look at the deformation (|7.5.2p for — t\ < t < 0. If the 
nilpotent changes for some —T\ < t < 0, the string (/+T2, . . . , F + t 2 ) is not 
involved, the induction hypothesis applies, so the parameter is not r-unitary. 
Otherwise at t = — t\ there is one less string with coordinates in an A T with 
r ^ 0, and again the induction hypothesis applies so the original parameter 
is not r-unitary. Thus we are reduced to the case < e < E. Then consider 
the nilpotent orbit for the parameter with t = —t\ + r 2 . In cases (1), (2) 
and (3) of (|7.5.3p . the new nilpotent is larger, and one of the strings is 

(e + r 2 ,...,F + r 2 ), (7.5.4) 

instead of (17,5.ip . and e + F > 0. The induction hypothesis applies, so the 
parameter is not r-unitary, nor is the original one. 

In case (4) of (17.5, 3h . the new nilpotent corresponds to the strings 

(f + T 2 ,...,E + T 2 ) (7.5.5) 

The induction hypothesis applies, so / + E = 0, —2 if / + E is even or 
/ + E = — 1 if it is odd. If this is the case, consider a new deformation in 
17.5.21 this time — 1 + t 2 < t < 0. We may as well assume that the parameter 
is r-irreducible in this interval, or else the argument from before gives the 
desired conclusion. So we arrive at the case when t = — 1 + r 2 . The new 
nilpotent corresponds to the strings 

(f + r 2 ,...,E-l + r 2 ), (e-l + n), (F + t 2 ). (7.5.6) 

Write the parameter as (x'; e — 1 + r 2 , F + r 2 ). Since e — 1 = F, the induced 
module 

1 = Ind GL(2)xG(n-2)i L (e ~ 1 + r 2 , F + T 2 ) ® L( X ')] (7.5.7) 

is unitarily induced from a module which is hermitian and r-irreducible. But 
the parameter on GL(2) is not unitary unless 6 — 1 = ^ = 0. Furthermore 
/ + E - 1 = 0, -2 if / + E is odd or / + E - 1 = -1 if / + E is even. So 
the original parameter (|7.5.ip is 

{i + n,...,E + n ), (i-£ + t 2 ,...,t 2 ) f + E = o, 

{l + n,...,E + n ), (-E + t 2 ,...,t 2 ) f + E = -2, (7.5.8) 

(1 + Tl,...,£ + Tl), (-£-l + T 2 ,. ..,T 2 ) f + E = -l. 

Apply the deformation t + t 2 in the second string with — r 2 < t < 0. We 
may as well assume that the parameter stays r-irreducible in this interval. 
But then the induction hypothesis applies at t = — t 2 because there is one 
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less string with coordinates in A T with However the first string does 

no satisfy the induction hypothesis. 

Assume |e| > E. The same argument applies, but this time it is e < E < 
that requires extra arguments, and in case (3) instead of case (4) of ()7.5.3j) 
we have to consider several deformations. 

7.6. Proof of necessary condition for unitarity in theorem 13.11 We 

first reduce to the case of theorem !7.2l The difference is that the coordinates 
in Aq may not form a h/2 for an even nilpotent orbit. However because 
of theorem 12.91 and properties of relevant K— types, r-reducibility and r- 
unitary are unaffected by small deformations of the x*i , . . . , x' r (notation as 
in (I2.9.3P ). So we can deform the strings corresponding to x'ii ■ ■ ■ ,Xr with 
coordinates in Aq, so that their coordinates are no longer in Aq. Then the 
assumptions in theorem 17.21 are satisfied. 

The argument now proceeds by analyzing each size of strings separately. 
In the deformations that we will consider, strings of different sizes cannot 
combine so that the nilpotent orbit attached to the parameter changes. 

Fix a size of strings with coordinates not in Aq. If the strings are not 
adapted, they can be written in the form 

(-E -l + Ti,...,E + Ti) < n < 1/2, E = e(mod Z). (7.6.1) 

So there is nothing to prove. Now consider a size of strings that are adapted. 
Suppose there are two strings of the form 

(-E -l + Ti,...,E-l + Ti), < n < 1/2, E = e(mod Z). (7.6.2) 

Let m := gl(2E+l) xg(n— 2E— 1), (recall thatg(a) means a subalgebra/Levi 
component of the same type as q of rank a) and write 

X := ((—E - 1 + Ti , . . . , E - 1 + n - -E - 1 + 7i, . . . , E - 1 + t;); X m)- (7.6.3) 

The module 

lnd G M \L(-E - 1 + n , . . . , E - 1 + n; -E - 1 + n , . . . , E - 1 +n) ® L( XM )} 

(7.6.4) 

is r-irreducible, and unitarily induced from a hermitian module on M where 
the module on GL(2E + \) is not unitary. Thus L(x) is n °t unitary either. 
So L(x) is unitary only if for each Tj there is at most one string of the form 

(-E-l+Ti,...,E-l+Ti). 

Suppose there are two strings as in (|7.6.ip with t\ < T2- If there is no 
string (— E + T3, . . . , E + T3) with t\ < T3 < T2, then when we deform 
(-E - 1 + n + t, . . . , E - 1 + ti + t) for < t < t 2 - n, X( Xt ) stays r- 
irreducible. At t = T2 — t\ we are in case (I7.6.2p . so the parameter is not 
unitary. 

On the other hand suppose that there are two strings of the form 

(— E + n, ...,E + Ti), same Tj. (7.6.5) 
Let m be as before, and write 

x : = ((-E + Ti ,...,E + r i ;-E + T i ,...,E + n); X m)- (7.6.6) 
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The module 

Ind%[L(-E +T i ,...,E + T i ;-E + T i ,...,E + T i )® L( X m)] (7.6.7) 

is irreducible, and unitarily induced from a hermitian module on M where 
the module on GL(2E + 1) is unitary. Thus L(x) is unitary if and only if 
L(xm) is unitary. 

So we may assume that for each Tj there is at most one string of the form 

(-E + Ti,...,E + Ti). 

Similarly if there are two strings of the form (— E + t%, . . . , E + t{) and 
(— E + T2-, ■ ■ ■ , E + T2), such that there is no string of the form (— E — 1 + 
T3, . . . , E — 1 + T3) with t\ < T3 < T2 we reduce to the case (|7.6.5p . 

Let Tfc be the largest such that a string of the form (— E + Tk, ■ ■ ■ , E + Tk) 
occurs, and Tk+i the smallest such that a string (— E — 1 + Tk+i, . . . ,E — 
1 + Tk+i) occurs. If Tfc > Tk+i, we can deform (— E + Tfc + 1, . . . , E + Tk + 1) 
with < i < 1 — Tk — Tk+i- No r-reducibility occurs, and we are again in 
case (I7.6.2p . The module is not unitary. If on the other hand Tk < Tk+i, the 
deformation (-E— I + t^+i +t, . . . , E — 1 + Tk+i — t) for < t < l — Tk — Tk+i 
brings us to the case (17.6.50 . 

Together the above arguments show that conditions (1) and (2) of theorem 
13.11 in types C,D must be satisfied. Remains to check that for the case of 
adapted strings, if there is an odd number of a given size IE + 1, then there 
is a dj = IE + 1. This is condition (3) in theorem 13.11 

The arguments above (also the unitarity proof in the case O = (0)) show 
that an L(x) is unitary only if it is of the following form. There is a Levi com- 
ponent m = gl{a\) x • • • x gl(a r ) x g(n — ^ aj), and parameters Xli ■ ■ ■ ? Xr, Xo 
such that, 

L( X ) = /ndft[(g) L(xi) ® L( X o)], (7.6.8) 
with the following additional properties: 

(1) The Xi f° r i > are as i n lemma (1) of section l3T2| with < v < 1/2, 
in particular unitary. 

(2) xo is such that there is at most one string for every A T with r / 0, 
and the strings are of different sizes. 

In addition, conditions (1) and (2) of theorem 13. 1 1 are satisfied for the strings. 
To complete the proof we therefore only need to consider the case of L(xo)- 
We can deform the parameters of the strings in the A T with r / to zero 
without r-reducibility occuring. If L(x) is unitary, then so is the parameter 
where we deform all but one r / to zero. But for a parameter with a 
single string belonging to an A T with r ^ 0, the necessary conditions for 
unitarity are given in section EH 

8. Real nilpotent orbits 

In this chapter we review some well known results for real nilpotent orbits. 
Some additional details and references can be found in |CM| . The notation 
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in this section differs from the previous sections. Fix a real form g of a 
complex semisimple Lie algebra g c . Let 9 C be the complexification of the 
Cartan involution 9 of g, and write — for the conjugation. Let G c be the 
adjoint group with Lie algebra g c , and let 

fl c = 6 c + s c , g = t + s (8.0.9) 

be the Cartan decomposition. Write K c C G c for the subgroup correspond- 
ing to t c , and G and K for the real Lie groups corresponding to g and 6. 

We refer to |CM| for standard results about the classification of AdG c 
nilpotent orbits in g c , Ad G nilpotent orbits on g, and Ad K c nilpotent orbits 
in s c , particularly the Kostant-Sekiguchi correspondence. 

8.1. To motivate the need for these results we start with a review of prop- 
erties the asymptotic associated support/cycle, and wave front set. 

Let 7T be an admissible (g c , K) module. We review some facts from |BVlj . 
The distribution character lifts to an invariant eigendistribution 9^ in 
a neighborhood of the identity in the Lie algebra. For / G C£°(U), where 
U C g is a small enough neighborhood of 0, let ft(X) := t _dimSc /(t _1 X). 
Then 

o,{ft) = t- d Y J c 3 f^ ) {f)+Y, td+lD ^{f)\- (8.1.1) 

j *>o 
The D{ are homogeneous invariant distributions (each Di is tempered and 
the support of its Fourier transform is contained in the nilpotent cone). The 
fiQ j are invariant measures supported on real forms Oj of a single com- 
plex orbit O c , and ^Oj(M.) 1S the Liouville measure on the nilpotent orbit 
associated to the symplectic form induced by the Cartan-Killing form. Fur- 
thermore d = dimcO c /2, and the number Cj is called the multiplicity of 
Oj(R) in the leading term of the expansion. The closure of the union of 
the supports of the Fourier transforms of all the terms occuring in (|8.1.ip is 
called the asymptotic support, denoted AS(n). The leading term in (|8.1.1|) 
will be called AC(n). We will use the fact that the nilpotent orbits in the 
leading term are contained in the wave front set of 9^ at the origin, denoted 
WF(tt). 

Alternatively, [V3] attaches to each tt a combination of ^-stable orbits 
with integer coefficients 

AV(w) = ^ajOj, (8.1.2) 

where Oj are nilpotent K c — orbits in s c . The main result of |SV] is that 
AC(tt) in (I8.1.1j) and AV(ir) in (I8.1.2P are the same. Precisely, the leading 
term in formula (18.1.1j) . and (|8.1.2p are the same, when we identify real and 
9 stable nilpotent orbits via the Kostant-Sekiguchi correspondence. We will 
use this when we need to compare AC(ir) and AV(tt). 

We will need results on how AC and AV behave under real and cohomo- 
logical induction. 
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8.2. Complex induction. Let p c = m c + n c be a parabolic subalgebra of 
g c . Let c c := AdM c ■ e be the orbit of a nilpotent element e G m c . According 
to [LSj . the induced orbit from c c is the unique G c orbit £ c which has the 
property that £ c n [c c + n c ] is dense (and open) in c c + n c . 

Proposition (1). Let E=e+n£e+ n c Cc c + n c 6ea representative of 

(1) dimZ Mc (e) = dim Z Gc (E). 

(2) £ c n [c c + n c ] is a single P c orbit. 

This is theorem 1.3 in [LSj . In particular, an element E' = e' + n' E c c + n c 
is in £ c if and only if the map 

adE' : p c ^T e ,c c + n c , &dE'(y) = [E f , y] (8.2.1) 

is onto. 

Another characterization of the induced orbit is the following. 

Proposition. The orbit (£ c is the unique open orbit in AdG c (e + n c ) = 
AdG c (c c + n c ), as well as in the closure AdG c (e + n c ) = AdG c (c^ + n c ). 

We omit the proof, but note that the statements about the closures follow 
from the fact that G c /P c is compact. 

Proposition (2). The orbit <£ c depends on c c C m c , but not on n c . 

Proof. This is proved in section 2 of [LSj . We give a different proof which 
generalizes to the real case. Let £ G f) c C m c be an element in the center 
of ro c such that (£, a) ^ for all roots a € A(n c , f) c ). Then by a standard 
argument, 

AdP c (£ + e) =£ + c c + n c . (8.2.2) 
Again because G c /P c is compact, 

(J Ad GM + e)\ (J Ad GM + e) = Ad G C {T C + n c ). (8.2.3) 

t>o t>o 

Formula 18.2.31 is valid for any parabolic subgroup with Levi component M c . 
The claim follows because the left hand side of (|8.2.3|) only depends on M c 
and the orbit c c . □ 

We write ind® c (e) or indpl(e) for the orbit of E. 

8.3. Real induction. Let p = m + n be a real parabolic subalgebra, e G m 
a nilpotent element, and c := Ad Me. 

Definition. The p— induced set from c to q is the finite union of orbits 
£j := AdGEi such that one of the following equivalent conditions hold. 

(1) €i is open in AdG(c + n) and (j£j = AdG(e + n). 

(2) The intersection (£, n [c + n] is open in c + n, and the union of the 
intersections is dense in c + tl. 
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We write 

wk#(c) = (J Ci. (8- 3 - 1 ) 
and we say that each is real or p— induced from e. Sometimes we will 
write indp(e). 

We omit the details of the proof of the equivalence of the two statements. 

Proposition. The p— induced set depends on the orbit c of e and the Levi 
component m, but not on n. 

Proof. The proof is essentially identical to the one in the complex case. We 
omit the details. □ 

The Kostant-Sekiguchi correspondence establishes a 1-1 correspondence 
between Ad G nilpotent orbits in q and Ad K c nilpotent orbits in s c . Denote 
by e < — ► e this correspondence. Then p— induction is computed in [BBj . 
This is as follows. Let f) c C m c be the complexification of a maximally split 
real Cartan subalgebra fj, and £ G Z(m c ) C\s c an element of F) such that 

a G A(n c , fj c ) if and only if a(£) > 0. 

Then 



m- 



[J Ad K c {Ei) = \jAdK c (tZ + e)\\jAdK c (# + e). (8.3.2 

t>o t>o 

Let p = m+n be a real parabolic subalgebra. Suppose AC(ir) = ^ CjOj, 
for a representation tt of M. Let u,- G C, m be representatives, and write 
Uj,- = + Ajj for representatives of the induced orbits Oij from O,- m . Then 
Oij Pi (Oj, m + n) is a finite union of P— orbits. Let be representatives. 
Then 



AC(Ind^(vr)) = ^ Cj , ^ 



Cc{vijk) 



Cp(vijk) 



(8.3.3) 



The argument is elementary and in |B4j . except the sum over k is missing. 
I would like to thank B.L. Harris for pointing out this gap. I believe that 
k = 1, but I do not know a general proof. In sections 18.71 18.81 18.91 and 18.101 
we list the Oij in the classical cases. We will show in all cases relevant to 
our goal that k = 1. This is done in the next lemma and corollary. 

Let a be conjugation on G c so that the fixed points are G, and denote by 
a the corresponding conjugation on g c as well. 

Lemma. Let E be induced from e G m, with p = m + n. Assume that every 
connected component of Cg c (E) intersects G. Then k = l in formula \8.3.3i 

Proof. In the notation of definition 18.31 let E 1 = e + A be a representative 
of one of the induced orbits. The claim is proved if we show that if 
E' = e + X' G e+n is conjugate to E by an element in G, then it is conjugate 
to E by an element in P. 

By (2) of proposition (1) 18.21 there isp c G P c such that Adp c E = AdgE = 
E' with g G G. Thus pjV^) G C Pe {E), and p^g = x G C Gc (E). Since 
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Cp c (E)\Cg c (E) is finite, the connected component of the identity of Cg c (E) 
is contained in Cp c {E). The element p c can be replaced by any other element 
in the coset p c Cp c (E). The assumption of the lemma implies then that we 
can choose p c so that x £ Cg{E). But then p c = gx~ l G P c n G = P as 
claimed. □ 

Remark. TTte same conclusion and proof hold if we only assume that each 
coset xCp(E) C Cg(E) which is fixed by a, contains a point fixed by a. 

Corollary. The assumptions of lemma \8.3\ hold in the classical cases. 

Proof. Let {E,H,F} be a Lie triple such that o~(E) = E, cr(H) = H and 
cr(F) = F. Then each component of Cg(E) and Cg c (E) respectively, inter- 
sects the component group of Cc{E, H, F) and Cg c (E, H, F) respectively. 
In the classical cases these are as follows. The inclusion Cq C Cq c is the 
usual one. Recall the notation for nilpotent orbits in 13.11 

Type A. C Gc (E, H, F) = ft GL(r h C) and Cq(E, H,F) = ]J GL(n, R). 
Type B,D. For G c = 0(n,C), C Gc (E,H,F) is a product of Sp(r if C) for 
cij even and 0(rj,C) for odd. For Cc(E, H, F), Sp(ri,C) is replaced by 
Sp(ri,M) and 0(rj,C) by 0(rf ,r~) where rf + r~ = r^. In the classification 
of nilpotent orbits referred to in section 18.101 rf is the number of rows of 
size a, starting with +, r~ is the number of rows of size Oj starting with — . 
There are minor modifications for G c = SO(n, C). 

Type C. For G c = Sp(2n,C), C Gc (E,H,F) is a product of Sp(r u C) for 
Oj odd and 0(rj,C) for Oj even. For Cq(E,H,F), Sp(ri,C) is replaced by 
Sp(ri,M) and 0(rj,C) by 0(rf,r^) with r^ 1 " + r 4 " = rj. In the classification 
of nilpotent orbits referred to in section [8791 rf is the number of rows of size 
dj starting with a +, r~ is the number of rows of size a, starting with a — . 

The claim of the corollary follows from this description. □ 

8.4. 9— stable induction. We will also use an analogue of (|8.3.3|) for 6- 
stable induction (derived functors construction or cohomological induction) 
and AV(tt). 

Let q c = [ c + u c be a 0-stable parabolic subgroup, and write = \ c + u7 
for its complex conjugate. Let e £ [ c n 5 C be a nilpotent element. 

Proposition. There is a unique K c — orbit Ok c {E) so that its intersection 
with OL c nK c (e) + (u c H s c ) is open and dense. Similarly there is a unique 
G c -orbit such that its intersection with Ol c (c) + u c is open and dense. 

Proof. This follows from the fact that e + (u c H S c ) is formed of nilpotent 
orbits, there are a finite number of nilpotent orbits, and being complex, the 
K c — orbits have even real dimension. Similarly for the case of G c -orbits. □ 

Definition. The unique orbit which intersects Ol c dk c (^) + (u c D s c ) in a 
dense open set is called ind^ nSc (e). 

Similarly write ind^(e) for the unique nilpotent G c — orbit which intersects 
Ol c (c) + u c in an open set. 
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Remark. The induced orbit is characterized by the property that it is the 
(unique) largest dimensional one which meets e + u c ns c . It depends on e as 
well as q c , not just e and [ c . □ 

We need a special case which is well known, e.g. [Trlj and |Tr2] . Fix 
a regular dominant integral infinitesimal character x, and let T> x be the 
sheaf of twisted differential operators on the flag variety H := G c /B c . The 
Beilinson-Bernstein localization functor A x provides an equivalence of cat- 
egories between admissible (g c , K) modules with infinitesimal character x> 
and K c — equi variant holonomic T> x — modules. Let q c = ( c + u c be a 6— stable 
parabolic subalgebra, 7 be the generalized flag variety of parabolic sub- 
algebras of type q c , and / : H> — > 7 the canonical projection map. Then 
01 := K c -c\ c C 7 is closed, and let R be the A" c -orbit which is open in J -1 (ft). 
Assume x is the (dominant integral) infinitesimal character of the trivial rep- 
resentation. Then T> x is the sheaf of usual differential operators T>%. Let T>y 
be the sheaf of differential operators on 7. Via the Riemann-Hilbert corre- 
spondence, regular K c — equivariant holonomic sheaves of T>%— modules on 
B are equivalent to K c — equivariant perverse sheaves (theorem 7.9 in |ABVj 
and reference therein) . In turn irreducible equivariant perverse sheaves cor- 
respond to local systems on K c orbits. If S is the Py— module corresponding 
to the trivial local system on ft, let S be the irreducible module correspond- 
ing to the trivial local system on R, and ir be the irreducible (g c , K) module 
corresponding to S by localization. Let Ch(ir) := C/i(S) be the characteris- 
tic cycle. A review of its definition and properties can be found for example 
in [A1W] chapte r 19. Then Ch(B) = T%?, the conormal bundle of ft. By 
theorem 20.1 of [ABV] . Ch(§) = T*B. 

Let 

H : T*S — ► g* 



be the moment map. Then /j,(T^B) = K c ■ (u c n S c ) is the closure of znd^ nSc (0). 

Proposition. Assume that x is the infinitesimal character of the trivial 
representation (dominant integral), and fi \t*"B is birational. Then 

AdG c ind£ n JO)=ind£(0), 

and 

^(7r)=ind£ nsc (0). 

Proof. The first assertion is a dimension count; recall that for e £ s c , 
dimAdG c e = 2dimAd-ftT c e. The second assertion follow from the results 
in |Chj . particularly corollary 2.5.6. Under the assumptions of the propo- 
sition, and the notation in |Chj preceding 2.5.6, F u is a single point, and 

C Fv = 1- □ 

Let £ be a unitary character of the Levi component of a stable parabolic 
subalgebra q c = [ c + u c . Cohomological induction, detailed e.g. in [KnV] . as- 
sociates to £ a family of (g c , K) modules 7£i(£). Recall S = dim(u c n£ c ) from 
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|KnVj . Extending the notion of AC or AV by linearity to the Grothendieck 
group, we can talk about AC (^(-1)^(0) or ^(£(-1)^(0). 

Corollary (1). Assume that the moment map [i \t*% is birational. Then 

Av(Y / (-iyn c (o) = (-if- 

In particular if £ is such that TZ l qc (^) = for i ^ S, then 

AV(Kl(0) = ind* q l nSc (0) 
(in particular TZ^Jy^) is also nonzero). 

Proof. Embed ir into a coherent family tt u as in [Chj . The assumptions 
imply that 

AC(tt 1/ ) = const -Ch(§) H {u,a)/ [] ( Pic , a) m< nac (0). (8.4.1) 

oeA+([ c ) oeA+([ c ) 

Setting v = £ + /?[ c , proposition 18.41 implies that const-CH(S) = 1. The proof 
follows from the fact that (-l) s ir„ = E(-!)^q c (£) for v = Z + Pt- D 

8.5. u(p,q). Let V be a complex finite dimensional vector space of dimen- 
sion n. There are two inner classes of real forms of GL(V). One is such that 
9 is an outer automorphism. It consists of the real form GL(n, IR), and when 
n is even, also U*(n). The other one is such that 9 is inner, and consists 
of the real forms U(p, q) with p + q = n. In sections I8.5H8.81 we investigate 
p and 9 induction for the forms u(p,q), and then derive the corresponding 
results for so(p,q) and sp(n,M) from them in sections 18. 9118.101 The corre- 
sponding results for the other real forms are easier, the case of GL(n,M) is 
well known, and we will not need u(n)* . The usual description of u(p, q) is 
that V is endowed with a hermitian form ( , ) of signature (p, q), and u(p, q) 
is the Lie algebra of skew hermitian matrices with respect to this form. Fix 
a positive definite hermitian form ( , ) . We will identify the complexification 
of g := u(p,q) with g c := gl(V), and the complexification of U{p,q) with 
GL(V). Up to conjugacy by GL(V), 

(v,w) = {9v,w), 9 2 = 1, (8.5.1) 

The eigenspaces of 9 on V will be denoted . The Cartan decomposition 
is q c = t c + s c , where t c is the +1 eigenspace, and s c the —1 eigenspace of 
Ad9. 

The classification of nilpotent orbits of u(p, q) is by signed tableaus as in 
theorem 9.3.3 of |CM| . The same parametrization applies to 9 stable orbits 
under K c . 
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8.6. A parabolic subalgebra of gl(V) is the stabilizer of a generalized flag 

(0) = W £ Wi £ • • • £ W k = V. (8.6.1) 

Fix complementary spaces Vi, 

Wi = Wi-i + V h i > 0. (8.6.2) 

They determine a Levi component 

l^gliV^x-.-xgliVk). (8.6.3) 

Conjugacy classes under K c of ^-stable parabolic subalgebras are 
parametrized by ordered pairs (pi, q±), . . . , (p k , q k ) such that the sum of the 
Pi is p, and the sum of the qi is q. A realization in terms of flags is as follows. 
Choose the Wi to be stable under 6, or equivalently that the restriction of 
the hermitian form to each Wi is nondegenerate. In this case we may assume 
that the Vi are ^-stable as well, and let q c = [ c + u c be the corresponding 
parabolic subalgebra of gl(V). The signature of the form restricted to Vi is 
(pi,qi), so that 

l c n g = u(pi,qi) x • • • x u(p k , q k ). (8.6.4) 
The following algorithm for computing the induced orbit in the case Q = 
u(p, q) and a maximal parabolic subalgebra holds. 

Suppose the signature ofV\ is (a+, a_). Then add a+ + 's to the beginning 
of largest possible rows of e starting with — and a_ — 's to the largest possible 
rows of e starting with +. If a+ is larger than the number of rows starting 
with — , add a new row of size 1 starting with +. The similar rule applies to 
a_. 

If e G gl(Vi), the analogous procedure applies, but the a + +'s are added 
at the end of the largest possible rows finishing in — and a_ — 's to the end 
of the largest possible rows finishing in +. 

Because induction is transitive, the above algorithm can be generalized 
to compute the ^-induced of any nilpotent orbit. We omit the details. See 
[TrT] and [Tr2] . 

8.7. Conjugacy classes under G of real parabolic subalgebras are given by 
ordered subsequences n\, . . . , rik and a pair (po, qo) such that Yl n i +Po — P 
and n i + Qo = Q- The complexification of the corresponding real parabolic 
subalgebra is given as follows. Start with a partial flag 

(0) = Wo£---£Wfc (8.7.1) 

such that the hermitian form is trivial when restricted to W^, and complete 
it to 

(0) = Wo £ • • • £ W k £ W fe * £ • • • £ Wq* = V (8.7.2) 
Choose transverse spaces 

W i = W i - 1 + Vi, W* = WU + V*, W fc * = W fc + ^ . (8.7.3) 
They determine a Levi component 

lc = gl(Vi) x • • • x gl(V k ) x gl(V ) x gl(V k *) x • • • x gl(V{), (8.7.4) 
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so that 

l c ne = gl(V 1 ,C) x ■■■ x 9 l(V k ,C) x u{p ,q ). (8.7.5) 
Then = dim V, and (po, go) is the signature of Vq. 

8.8. Suppose p c = m c + n c is the complexification of a real parabolic sub- 
algebra corresponding to the flag (0) C V\ C V\ + Vq C Vi + Vq + V*, and 
let e C ^Z(Vb) be a real nilpotent element. The rest of the notation is as in 
section I 



Theorem. The tableau of an orbit AdG(Ei) which is in the p— induced set 
indp(c), is obtained from the tableau of e as follows. 

Add two boxes to the end of each of dim V\ of the largest rows such that 
the result is still a signed tableau. 

Proof. We use (|ST21> and EB| . Let a £ Hom^i,^] ©Hom[Vi*,Vi] be 
nondegenerate such that a 2 = Id® Id, and extend it to an endomorphism 
£ £ 5^(V) so that its restriction to Vq is zero. This is an element such that 
the centralizer of ad£ is m, in particular, [£, e] = 0. Let 

P(X) = X m + o^il 1 "- 1 + • • • + a (8.8.1) 

be any polynomial in X £ gl(V). Suppose t% £ R are such that — > 0, and 
assume there are gi £ K such that Ug^ + e)g~ l — > E. Then 

kerC^^ + e)^ 1 ) =kerP(£ + e). (8.8.2) 

On the other hand, 

t?P{ 9i {i + e)gr l ) = [t i9l (C + e)g^]™+ § 
+ a^UiUg^ + e)gr 1 Y n - 1 + ■■■ + t?Id - E m , 

as tj — > 0. Thus 

dim ker E m | v ± > dim ker P(£ + e) \ v± . (8.8.4) 

Choosing P(X) = (X 2 — l)X n , we conclude that E must be nilpotent. 
Choosing P{X) = X m , (X ± l)^" 1 - 1 or P(X) = (X 2 - l)X m ~ 2 , we can 
bound the dimensions of ker E m |y ± to conclude that it must be in the closure 
of one of the nilpotent orbits given by the algorithm of the theorem. The 
fact that these nilpotent orbits are in (|8,2.3p follows by a direct calculation 
which we omit. □ 

8.9. sp(V). Suppose g c = sp(Vo), where (Vo, ( , )) is a real symplectic 
vector space of dimension n. The complexification (V, ( , )) admits a complex 
conjugation — , and we define a nondegenerate hermitian form 

{v,w):=(v,w} (8.9.1) 

which is of signature (n,n). Denote by u(n,n) the corresponding unitary 
group. Since sp(Vo) stabilizes ( , ), it embeds in u(n,n), and the Cartan 
involutions are compatible. The classification of nilpotent orbits is as follows. 
See chapter 9 of [CM] for a more detailed explanation. 
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Each orbit corresponds to a signed tableau so that every odd part occurs an 
even number of times. Odd sized rows occur in pairs, one starting with + 
the other with —. Even sized rows start with a + or a — . 

A real parabolic subalgebra of sp(V) is the stabilizer of a flag of isotropic 
subspaces 

(0) = W C • • • C W k , (8.9.2) 

so that the symplectic form restricts to on W k . As before, complete this 
to a flag 

(0) = Wo C • • • C Wjfc C W/t C • • • C Wg = V. (8.9.3) 
We choose transverse spaces 

Wi = Wi-i + Vi, W£ = W fc + W, W*_ l =W*+V* (8.9.4) 

in order to fix a Levi component. We get 

I gl{V{) x • • • x gl(V k ) x sp{W). (8.9.5) 

If we assume that Vi, W are ^-stable, then the corresponding parabolic 
subalgebra is ^-stable as well, and the real points of the Levi component are 

to = w(pi,?i) x • • • x u(p k ,q k ) x sp(Wo). (8.9.6) 

where (pi,qi) is the signature of Vi. The Levi component of the parabolic 
subalgebra corresponding to (|8.9.4p in gl(V) satisfies 

[' = u(pi,qi) x • • • x u(p k ,q k ) xu(n ,n ) xu(q kl p k ) x • • • x u(qi,pi). (8.9.7) 

For a maximal ^-stable parabolic subalgebra, the Levi component [ satis- 
fies [ = u(pi,qi) x sp(Wo)- Let e E sp{W) be a ^-stable nilpotent element. 
The algorithm for induced nilpotent orbits in section HTBl implies the follow- 
ing algorithm for indq c (e). 

(1) add p boxes labelled +'s to the beginning of the longest rows starting 
with — 's, and q — 's to the beginning of the longest rows starting with 
+'s. 

(2) add q +'s to the ending of the longest possible rows starting with 
— 's, and p — 's to the beginning of the longest possible rows starting 
with +'s. 

Unlike in the complex case, the result is automatically the signed tableau 
corresponding to a nilpotent element in sp(V). Again see [Trl] and |Tr2] for 
details. 

For a maximal real parabolic subalgebra, we must assume that V\ = 
V±, W = W. Let Vifl and Wo be their real points. The Levi component 
satisfies 

l^gl(V lfi ) xsp(Wo). (8.9.8) 

The results in section 18.81 imply the following algorithm for real induction. 

(1) add two boxes to the largest dimFi rows of e so that the result is 
still a signed tableau for a nilpotent orbit. 
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(2) Suppose dim V\ is odd and the last row that would be increased by 
2 is odd size as well. In this case there is a pair of rows of this size, 
one starting with + the other with — . In this case increase these two 
rows by one each. 

8.10. so(p,q). Suppose q c = so(Vq) , where (Vo, ( , ) ) is a real nondegenerate 
quadratic space of signature (p, q) . The complexification admits a hermitian 
form ( , ) with signature (p, q) as well as a complex nondegenerate quadratic 
form ( , ), which restrict to ( , ) on Vo- The form ( , } gives an embedding 
of o(p, q) into u(p, q) with compatible Cartan involutions. The classification 
of nilpotent orbits of so(Vq) or equivalently ^-stable nilpotent orbits is as 
follows. See chapter 9 of [CM] for more details. 

Orbits correspond to signed tableaus so that every even part occurs an even 
number of times. Even sized rows occur in pairs, one starting with + the 
other with —. An odd sized row starts with a + or a —. When all the rows 
have even sizes, there are two nilpotent orbits denoted I and II. 

A parabolic subalgebra of so(V) is the stabilizer of a flag of isotropic 
subspaces 

(0) = W C ••• C W k , (8.10.1) 
so that the quadratic form restricts to on Wfc. As before, complete this to 
a flag 

(0) = W C • • • C W fc CWf C • • • C W * = V. (8.10.2) 
We choose transverse spaces 

Wi = Wi-i + Vi, W^ = W fc + W, Wl 1 = W* + V* (8.10.3) 
in order to fix a Levi component, 

[ * gl(V{) x • • • x gl(V k ) x so(W). (8.10.4) 

To get a 0-stable parabolic subalgebra we must assume Vi, W are ^-stable 
and so Vi = V* , W = W. If the signature of Vi with respect to ( , ) is 
(pi,q%), and that of W is (po><7o)> then 

to = u(pi,qi) x • • • x u(p k , q k ) x so(p , q ). (8.10.5) 

The parabolic subalgebra corresponding to (|8.10.2p in gl(V) satisfies 

I' = u(pi,qi) x • • ■xu{p k ,qk)xu(po,<lo)xu(Pk,qk) x ■ ■ ■ xu(pi,qi). (8.10.6) 

For a maximal ^-stable parabolic subalgebra, the Levi component [ satisfies 
[ = u(pi,qi) x so(Wo). Let e G so(W) be a 0-stable nilpotent element. The 
algorithm for induced nilpotent orbits in section 18.61 implies the following 
algorithm for ind® c c (e). 

(1) add pi +'s to the beginning of the longest possible rows starting 
with — 's, and q\ — 's to the beginning of the longest possible rows 
starting with +'s. 

(2) add pi +'s to the ending of the longest possible rows starting with 
— 's, and qi — 's to the beginning of the longest possible rows starting 
with +'s. 
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Unlike in the complex case, the result is automatically a signed tableau for 
a nilpotent element in so(V). 

For a maximal real parabolic subalgebra, we must assume that V\ = 
V±, W = W. Let V±fi and Wo be their real points. The Levi component 
satisfies 

l^gl(V 1)0 )xso(W ). (8.10.7) 
The results in section 18.81 imply the following algorithm for real induction. 

Add two boxes to dim V\ of the largest possible rows so that the result is still 
a signed tableau for a nilpotent orbit. Suppose dim V\ is even and the last 
row that would be increased by 2 is even size as well. In this case there is 
a pair of rows of this size, one starting with + the other with —. Increase 
these two rows by one each so that the result is still a signed tableau. When 
there are only even sized rows and dim V\ is even as well, type I goes to type 
I and type II goes to type II. 

9. Unitarity 

In this section we prove the unitarity of the representations of the form 
L(x) where x = h/2. As already mentioned, in the p— adic case this is 
done in [BMlj . It amounts to the observation that the Iwahori-Matsumoto 
involution preserves unitarity, and takes such an L{\) into a tempered rep- 
resentation. 

The idea of the proof in the real case is described in |B2j . We will do an 
induction on rank. We rely heavily on the properties of the wave front set, 
asymptotic support and associated variety, and their relations to primitive 
ideal cells and Harish-Chandra cells. We review the needed facts in sections 
IQIOl Details are in [BVl] . [BV2] . and [B3]. In sections EMM we give 
details of the proof of the unitarity in the case of SO(2n + 1). The proof is 
simpler than in |B2j . 

9.1. We will make heavy use of the results in [V2j . Fix a regular integral 
infinitesimal character Xreg- Let Q G {Xreg) be the set of parameters of irre- 
ducible admissible (g c , K) modules with infinitesimal character Xreg- We will 
suppress the superscript G whenever there is no danger of confusion. The 
explicit description of Q G (xreg) is well known, called the Langlands or Vo- 
gan classification. We will use the description in [V2]. Denote by ^G(xreg) 
the corresponding Grothendieck group of characters. Recall from [V2] (and 
references therein) that there is an action of the Weyl group on l*Q(xreg), 
called the coherent continuation action. As a set, Q{xreg) decomposes into 
a disjoint union of blocks B, and so 7LQ decomposes into a direct sum 



WiXreg) = @%?(Xre 9 )- 



(9.1.1) 
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Each "LGsiXreg) is preserved by the coherent continuation action. We give 
the explicit description of the 7LQb in all classical cases. Many of the details, 
and complementary explanations can be found in |McGj . 
Type B: In order to conform to the duality between type B and type C in 
[V2j . we only consider the real forms with p > q. The Weyl group acts on 
the linear space ^ ZQ so ^ p ' q \xreg), and the representation is 

P>Q (9.1.2) 

= ^ Ind w n a xW b xW 2 sXS t i s 9 n ® s 9 n ® O'h 7 "] ® triv l 
a,b,T 

where r is a partition of s, and a + b + 2s + t = n. The multiplicity of a 
(t[tl, tr] in one of the induced modules in (|9.1.2p is as follows. Choose a r 
that fits inside both tl and tr, and label it by »'s. Add "a" r and "b" r 1 
to tr, at most one to each row for inducing from the sign representations 
of W a and Wb- Add "t" c, at most one to each column, to tl or tr for 
inducing from the trivial representation on St. The multiplicity of a in the 
induced module for a given (r, a, 6) is then the number of ways that tl, tr 
can be filled in this way. This procedure uses induction in stages, and the 
well known formula 

Indf : (triv)= *P)>(01- (9-1-3) 

k+l=n 

Example. Let q c = so(5). The real forms are so(3, 2), so(4, 1), so(5). The 
choices of (r, a, b, t) are 



(1,1,0,0), (1,0,1,0), (1,0,0,1), (9.1.4) 
(0,2,0,0), (0,1,1,0)), (0,1,0,1), (0,0,2,0), (0,0,1,1), (0,0,0,2). 

Let a = c[(l), (1)]. Then its multiplicity is given by the number of labelings 

(•>•) 0, 0, 

0, 0, (c,r), 0, (c,r'), (c,c). (9 ' L5) 
For a = <t[(0),(2)] we get 
0, 0, 

0, (0,rr'), (0,rc), 0, (0,r'c), (0, cc) 

□ 

The following formula sorts the representations according to the various 
real forms SO(p, q) with p + q = 2n + 1. Each real form gives a single block. 
A representation occuring in Q, labelled as above, occurs in 

igso( P , q ) with 

, 1 , I // / u I , /O if #r'>#r, 

p = re + 1+ | #r — #r | — e, where e = < (9.1.7) 

1 otherwise. 
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In the above example, (•,•), (c, c), (0, rr'), (0, rc) and (0, cc) belong to 
so(3, 2) while (c, r') and (0, r'c) belong to so(4, 1). 

To each pair of partitions parametrizing a representation of W, 

tl = (r ,. . . ,r 2m ), tr = (n,. . . ,r 2m _i), r, < r i+2 , (9.1.8) 

Lusztig attaches a symbol 

V r 2 + 1 ... r 2m + m N 



(9.1.9) 

n r 3 + 1 . . . T 2m _i + m - 1 

The symbol is called special if 

r < n < r 2 + 1 < r 3 + 1 < • • • < r 2m + m. (9.1.10) 

Two representations belong to the same double cell if and only if their sym- 
bols have the same entries. Given a special symbol of the form (|9.1.9p . the 
corresponding nilpotent orbit O c has partition obtained as follows. Form 
the set 

{2r 2i + 2i + 1, 2r 2j _i + 2j - 2: < i < m, 1 < j < m}, (9.1.11) 

and order the numbers in increasing order, x$ < • • • < x 2m . The partition of 
O c is 

(x , xi-l,...,Xi-i,..., x 2m ~ 2m). (9.1.12) 

Type C: The representation Qixreg) is obtained from the one in type B 
by tensoring with sign. Thus 

%G(Xreg) = ^ Ind f^W 2s xW a xW b [ s 9 n ® <t[t,t\ ® triv ® triv], (9.1.13) 

a,b,r 

where r is a partition of s, and a + b+2s + t = n. This takes into account the 
duality in [V2] of types B and C. We write r for the sign representation of 
St, and c and d for the trivial representations of W a , Wj,. A representation 
of T-F is parametrized by a pair of partitions (tl,tr), with 

7"l = (r , • • • ,r 2m ), tr = (ri, . . . ,r 2m -i), n < r i+2 . (9.1.14) 

The associated symbol is 

V r 2 + 1 ... r 2m + m N 



(9.1.15) 

ri r 3 + 1 . . . r 2m _i + m — 1 

and it is called special if 

^0 < i~i < r 2 + 1 < r 3 + 1 < • • • < r 2m + m. (9.1.16) 

Two representations belong to the same double cell if their symbols have 
the same entries. Given a special symbol as in (|9.1.15p . the nilpotent orbit 
O c attached to the double cell has partition obtained as follows. Order the 
set 

{2r 2i + 2i, 2r 2j „i + 2j - 1: < i < m, 1 < j < m} (9.1.17) 
in increasing order, xq < • • • < x 2m . Then the partition of O c is 

(x ,...,Xj - j,...,x 2m -2m). (9.1.18) 
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The decomposition into blocks is obtained from the one for type B by ten- 
soring with sgn. 

Type D: Since in this case ct[tl,tr] and o~[tr,tl] parametrize the same 
representation, (except of course when tl = tr which corresponds to two 
nonisomorphic representations), we assume that the size of tl is the larger 
one. The Cartan subgroups are parametrized by integers (t, u, 2s, p, q), p + 
q + 2s + t + u = n. There are actually two Cartan subgroups for each s > 0, 
related by the outer automorphism of order 2. Then 

^ t Zg s °M( Xreg )= (9.1.19) 

= Ind wtxw b xwi s xw t xwj s 9 n ® s 9 n ® a l T > T h,n ® triv ® triv]. 

where a + b + 2s + t + u = n. The sum is also over r which is a partition 
of s. We label the a by »'s, trivial representations by c and d and the sgn 
representations by r and r'. These are added to tl when inducing. In this 
case the sum on the left is over the real forms SO(p, q) with all p + q = In. 
Each real form gives rise to a single block. A representation labelled as 
above belongs to the block W J Q so ^P'i) with p = n + #r' — #r. 
If 

tl = (ro, ■ ■ ■ ,r 2m -2), tr = (ri, . . . ,r 2m -i), (9.1.20) 
then the associated symbol is 



r r 2 + 1 ... r 2m ~2 + m - 1 
n r 3 + l ... r 2m -i + m - 1 



(9.1.21) 



A representation is called special if the symbol satisfies 

r < n < r 2 + 1 < r 3 + 1 < • • • < r 2m _i + m - 1. (9.1.22) 

Two representations belong to the same double cell if their symbols have 
the same entries. The nilpotent orbit O c attached to the special symbol is 
given by the same procedure as for type B. 

9.2. We follow section 14 of [V2j . We say that ir' < tt if ir' is a factor of 

7T® F with F a finite dimensional representation with highest weight equal to 

an integer sum of roots. Two irreducible representations ir, ir' are said to be 

in the same Harish-Chandra cell if ir' < n and ir < ir' . The Harish-Chandra 

cell of ir is denoted C(ir). 

lr 

Recall the relation < from definition 14.6 of [V2] , The cone above ir is 

defined to be 

C LR (ir) :={ir' : ir' L < ir}. (9.2.1) 
The subspace in 7LQ generated by the elements in C (ir) is a representation 
of W denoted V LR {ir). The equivalence w is defined by 

LR LR, LR 

7 w (j) 7 < < 7 . (9.2.2) 
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The Harish-Chandra cell C(ir) is then 

C(tt) = {7t' : tt' L £it}. (9.2.3) 

Define 

C ^ (vr)= C L V)\C(7r) (9.2.4) 

£ 

and V(tt) and V (tt)+ in analogy with V (7r). Thus there is a represen- 
tation of W on V(tt) by the natural isomorphism 

V(vr) ^F LR (7r)/V LR (7r) + . (9.2.5) 

Let O c C 0c be a nilpotent orbit. We say that a Harish-Chandra cell C(ir) 
is attached to a complex orbit O c if 



AdG c (AS(7T)) = C> c . 

The sum of the Harish Chandra cells attached to O c is denoted V(O c ). 

Let \) a C Q c be an abstract Cartan subalgebra and let II a be a set of 
(abstract) simple roots. Let 7 be a Langlands parameter of an irreducible 
representation £(7) with infinitesimal character the same as the trivial repre- 
sentation (or some fixed finite dimensional representation). Denote by t( 7 ) 
the r— invariant as defined in [V2]. Given a block B and disjoint orthogonal 
sets Si, ^2 C II a , define 

B(Si, S 2 ) = { 7 eB\SiC t( 7 ), S 2 n r( 7 ) = 0} . (9.2.6) 

If in addition we are given a nilpotent orbit O c C g c , we can also define 

B{Si, S 2 , O c ) = {7 e S 2 )| AS(£( 7 )) C OA . (9.2.7) 

If an Si is absent from the notation, assume Si = 0. 

Let Wi = W(Si), and define 

m s (cr) = [a : Ind$ ixW2 (Sgn ® Triv)], ^ ^ 

m B (a) = [a : QeiXreg)] ■ 

In the case of G c viewed as a real group, the cones defined by (|9,2.ip are 

LR 

parametrized by nilpotent orbits in q c . In other words, tt < tt if and only if 
AS (n') C AS (it). So let C(O c ) be the cone corresponding to O c . Note that 
in this case W c = W x W, and the representations are of the form a (g> a. 

Theorem. Let G be the real points of a connected linear reductive group 
G c . Then 

\B(Si,S 2 ,O c )\ = Yl rn B (a)m s (a) . 

ct®o-£C(O c ) 

Proof. Consider ZB{S 1 ,S 2 ,O c ) C ZB(0,0,O C ). Then B(0,0,O C ) is a repre- 
sentation of which consists of the representations in V(ir) with AS^vr) C 
O c . The fact that the representation V(tt) is formed of a with a® a € C(O c ) 
follows from the argument before theorem 1 of |McG| . This accounts for 
mg(cr) in the sum. The expressions of the action of W given by lemma 14.7 
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in [V2j and Frobenius reciprocity imply that the dimension of 7LB(S\, S 2 , O c ) 
equals the left hand side of the formula in the theorem, and it equals the 
cardinality of B(Si, S 2 , O c ). □ 

9.3. Assume that is even. Then A := h/2 is integral, and it defines a set 
S 2 by 

S 2 = 5(A) = {ae U a \(a, A) = 0}. (9.3.1) 

Let O c be the nilpotent orbit attached to by the duality in |BV3j . Then 
the special unipotent representations Unip(0 attached to O, are defined to be 
the representations it with infinitesimal character A and AS(ir) C O c . The 
translation principle discussed in greater detail in chapter 16 particularly 
lemma 16.2 and theorem 16.4 of [ABVj (see also definition 8.6 in |AB Vj ) . 
establish a bijection between the irreducible admissible representations in 
U<6(0, S'(A)) at regular integral infinitesimal character A', and irreducible 
admissible representations at infinitesimal character A. Because this bijec- 
tion is realized as tensoring with a finite dimensional representation and 
projecting onto the appropriate infinitesimal character, AS(tt) is preserved. 
Thus there is a bijection 

Unip{0) < — ► (J B(0, 5(A), O c ). (9.3.2) 

B 

So we can use theorem 19.31 to count the number of unipotent representa- 
tions. In the classical groups case, me(cj) is straightforward to compute. 
For the special unipotent case, ms(cr) equals except for the representa- 
tions occuring in a particular left cell sometimes also called the Lusztig cell, 
which we denote C (O c ). The multiplicities of the representations occuring 

in C (O c ) are all 1. These representations are in 1-1 correspondence with 
the conjugacy classes in Lusztig's quotient of the component group A(0). 
See |BV2] for details. 

Theorem (1). 

\Unip{6)\ = Y J E m ^ a ) ■ 
B aec L (o c ) 

Theorem (2, |McG| ). In the classical groups Sp(n), SO(p,q), each Harish- 
Chandra cell is of the form C (O c ). 

Definition. We say that a nilpotent orbit O c is smoothly cuspidal if it 

satisfies 

Type B: all odd sizes except for the largest one occur an even number 
of times, 

Type C: all even sizes occur an even number of times, 
Type D: all odd sizes occur an even number of times, 

For 0(R), a real form of O c , write A(0(M)) for its (real) component group. 
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Proposition (1). Let O c be a smoothly cuspidal orbit with dual 6. Then 
A{6) = A(6), and in particular, \C L (O c )\ = \A{0)\. Furthermore, 

\Ump{6))\ = \A(0(JR))\ 
O(R) 

where the sum is over all real forms 0(M) of O c . 

Proof. This is theorem 5.3 in [B2]. The proof consists of a direct calculation 
of multiplicities in the coherent continuation representation using the results 
developed earlier in this section. □ 

Remark. This proposition does not hold for orbits that are not smoothly 
cuspidal. An example is when O c is the principal nilpotent orbit. □ 

We omit the proof of the following proposition. It involves results of 
Borho, MacPherson, Joseph and Kashiwara which say that the AS— set of 
an irreducible highest weight module is the closure of a single nilpotent orbit. 
See references in |BV3j , and also another proof in |V4j . 

Proposition (2). Assume O is even. Then the AS— set of L(xq) satisfies 
the property that Ad G c (AS(L(xq))) is the closure of the special orbit O c 
dual (in the sense of |BV3] ) to O. 

9.4. We now return to type G = SO(2n + 1). Consider the spherical irre- 
ducible representation L(xo) with Xo = h/2 corresponding to a nilpotent 
orbit O in sp{n). If the orbit O meets a proper Levi component m, then 
L{0) is a subquotient of a representation which is unitarily induced from a 
unipotent representation on m (compare with (jl.0.3p ). By induction, L(xq) 
is unitary. Thus we only consider the cases when O does not meet any 
proper Levi component. This means 

O = (2x , . . . , 2x 2m ), < x < ■ ■ ■ < Xi < xi+i < ■ ■ ■ < x 2m , (9.4.1) 

so these orbits are even. 

Proposition. Let O be as in \9.J^. Ity . The Harish- Chandra cell of L(xo) 
corresponds to O c with partition 

(1, . . . , 1, 2, . . . , 2, . . . , 2m, . . . , 2m, 2m + 1, . . . , 2m + 1), (9.4.2) 

where 

r 2i+l = 2(x 2m _2i — X 2m -2i~l + 1); 
f2i = 2(x 2m _2i+l — X2m-2i ~ 1), 
^2m+l = 2x + l. 

The columns of O c are (2x2 m + L 2x2 m -i — 1 5 • • • ; 2xq + 1). 

Proof. The proof is a calculation involving Lusztig cells and their duals. We 
omit the details. □ 
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Remark. In general if O is distinguished, then O c is smoothly cuspidal. 
But there are many more smoothly cuspidal orbits. For example the orbit 
with partition (2, 2) in sp(4) is smoothly cuspidal, but its dual is O with 
partition (1,1,3) which is not distinguished. 

Definition. Given an orbit O c with partition \9.J^.^ or more generally a 
smoothly cuspidal orbit, we call the split real form O sp i the one which satisfies 
for each row size, 

Type C,D: the number of rows starting with + and — is equal, 
Type B: in addition to the condition in types C,D for rows of size less 

than 2m + 1, for size 2m + 1, the number of starting with + is one 

more than those starting with —. 

Theorem. The WF—set of the spherical representation L{xq) with O sat- 
isfying ^9.4-l\ ) is the closure of the split real form O sp i of the (complex) orbit 
O c given by RT£fy . 

Proof. The main idea is outlined in |B2j . We use the fact that if tt is a factor 
of tt', then WF(ir) C WF(ir'). We do an induction on m, the number of 
parts in the partition of O. The claim amounts to showing that if E occurs 
in WF{L(xo))i then the signatures of E, E 2 , . . . are greater than the pairs 

(x 2m + l,^2m), (X2m + X 2m -i,X 2m + X 2m -l), ■■■ , 

■ ■■(x 2m -\ \-x 1 ,x 2m -\ (9.4.3) 

{x 2m H 1- x 1 + x + 1, x 2m H h xi + x ). 

The first pair is the signature of E, the second the signature of E 2 and so 
on. The first pair of numbers is obtained by counting the +'s and — 's in the 
first column of the nilpotent orbit, the second pair by counting the same in 
the first two columns and so on. 

The statement is clear when m = 0; L{\q) is the trivial representation. 
Let 0\ be the nilpotent orbit corresponding to 

(2x Q ,...,2x 2m - 2 ). (9.4.4) 

By induction, WF{L{xq 1 )) is the split real form of the nilpotent orbit cor- 
responding to the partition 

(1, . . . , 1, 2, . . . , 2, . . . , 2m - 2, . . . , 2m - 2, 2m - 1, . . . , 2m - 1), (9.4.5) 



where the columns are (2x 2m -2 + ^, 2x 2m -3 — l, ■ ■ ■ , 2xo + l). Let p be the real 
parabolic subalgebra with Levi component g(n — x 2m — x 2m _i) x gl{x 2m + 
x 2 m-i)- There is a character x of gl(x 2m + x 2m -i) such that tt := L(xo) 1S a 
factor of vr' := Indl[L{x^) ®x]- But b Y section^ WF(tt') is in the closure 
of nilpotent orbits corresponding to partitions 

(2, . . . , 2, . . . , 2m, . . . , 2m , 2m + 1, . . . , 2m + 1 ), if r x even, (9.4.6) 

r 1 /2+r 2 r 2m r 2m +i 
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or 



(1,1, 2,..., 2 , . . . , 2m, . . . , 2m , 2m + 1, . . . , 2m + 1 ), if r x odd, (9.4.7) 

(n-l)/2+r 2 r 2m r 2m+ i 

and the dots refer to sizes as in (|9.4,2p . It follows that the signatures for E k 
in WF(L(xq)) are greater than the pairs 

(a + ,a_), (x 2m + X 2 m-l,X 2 m + x 2m -i), ■ ■ ■ , (9.4.8) 

for some a + + a_ = X2 m + 1, and the dots are pairs as in (|9.4,3p . Also, each 
row size greater than two and less than 2m + 1 has an equal number that 
start with + and — . For size 2m + 1 there is one more row starting with + 
than — . 

We now do the same argument with O2 corresponding to 

(2x , . . . , 2x 2 m- 3, 2x2m- 2,2x2m- l,2x 2 m)- 

The WF— set correponding to L(xo 2 ) is the split real form of the nilpotent 
orbit with partition 

(1, . . . , 1, 2, . . . , 2, . . . , 2m - 2, . . . , 2m - 2, 2m - 1, . . . , 2m - 1), (9.4.9) 



with columns (2x 2m + 1, 2x2 m -3 — L • • • > 2xq + 1). Let p be the real parabolic 
subalgebra with Levi component £)(n — X2m-i — %2m-2) x gl{%2m-i + X2m-2)- 
There is a character x of gl(x2m- \ +X2m-2) such that it := L(xo) 1S a factor 
of 7r := Indp[L(xo 2 ) ® x]- But by section [51 WF(tt ) is in the closure of 
nilpotent orbits corresponding to partitions 

(1, . . . , 1, 3, . . . , 3, . . . , 2m, . . . , 2m, 2m + 1, . . . , 2m + 1), if T2 even, 

T2/2+rs Tim »*2m+l 

(9.4.10) 

or 

( 1,...,1 ,2,2, 3,. ..,3 ..., 2m,. . ., 2m , 2m + 1, . . . , 2m + 1 ), if r 2 odd. 

ri+(r 2 -l)/2 (r 2 -l)/2+r 3 r 2m r 2m +i 

(9.4.11) 

where the dots refer to pairs as in (|9.4.2j) . Thus WF{L{xq)) is also contained 
in the closure of the nilpotent orbits with signatures 

(x 2m + l,x 2m ), (x 2m + 1 + a+,x 2m + a_), 

(9.4.12) 

(x 2m + 1 + X2m-1 + X2m-2,X2m + 1 + X 2m -1 + X 2m -2), ■■■ , 

for some a + + a_ = x 2m _i, and the dots refer to pairs as in ()9.4.3[) . 

The claim follows. □ 
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9.5. Consider the special case when 

X = Xl - 1 < X 2 = X 3 - 1 < • • • < X 2m -2 = X 2 m-1 ~l< X 2m . (9.5.1) 

This makes O c of the form (|9.4,2p with r 2 % = 0, i.e. the partition of O c has 

only odd terms. The (Lusztig) cell C (O c ) has size 2 m (which is true for 
any O c with O distinguished, not just for the particular form (|9.5.ip ). We 
produce 2 m distinct irreducible representations with AC— set equal to O sp \. 
So g is so(2p + l,2p). Let f) be the compact Cartan subalgebra. We write 
the coordinates 

(ai, . . . ,a p | bi, . . . ,b p ) (9.5.2) 

where the first p coordinates before the | are in the Cartan subalgebra of 
so(2p + 1) the last p coordinates are in so(2p). The roots e» ± with 
1 < h 3 ^ P are an compact and so are e p+ k ± e p+ i with 1 < k, I < p. The 
roots 6i±e p+ k, e p +fc are noncompact. Let q c = l c +u c be a ^-stable parabolic 
subalgebra with Levi component 



I := l c n =u(x 2 i 1+ i,x 2 i 1 ) x u(x 2 i 2 ,x 2 i 2 +i) x • • • x 
u(x 2 i m _ 1 ,X2i m _ 1+ i) x so(x 2m + l,x 2m ), 
or (9.5.3) 

I := l c n =u(x 2il+1 ,x 2il ) x u(x 2i2 ,x 2i2+ i) x • • • x 
u{x 2 i m _ 1+ i,x 2im _ 1 ) x so(x 2m + l,x 2m ), 

(depending on the parity of m) where the ij are the numbers 0, . . . , m — 1 
in some order. The parabolic subalgebra q c corresponds to the weight 

£ = (m X2i i +1 ,...,l X2i ™-i +1 ,0 XUm | m X2l i , . . . , l X2s ™- i,0 X2m ), 

or (9.5.4) 

f = (m X2i i+ 1 ,...,l :C2 ^-i,0 X2m | m* 2 ^ , . . . , l* 2 *— i +1 ,0 a:2m ), 

depending whether m is odd or even. 

The derived functor modules 7£q c (£) from characters on l c have ^4C-set 
contained in O sv \. To get infinitesimal character Xcn these characters can 
only be 

^ :=±(l/2,...,l/2), (9.5.5) 

on the unitary factors u{x 2ij+ i,x 2ij ) or u(x 2ij ,x 2ij+ i), and trivial on g(x 2m ). 
We need to show that there are choices of parabolic subalgebras q c as in 
(|9.5.3p and characters as in (|9.5.5p so that we get 2 m nonzero and distinct 
representations. For this we have to specify the Langlands parameters. 

For each subset A := {k\, . . . , k r } C {0, . . . , m — 1}, kj in decreasing order, 
label the complement A c := {£i, . . . ,£t}, A c also labeled in decreasing order, 
and consider the 6— stable parabolic subalgebra q Ct A as in (|9.5.3p and (I9.5.4P 
corresponding to 

{ii,. . . ,i m -i} = {h, ...,k r , £!,... ,£ t }. (9.5.6) 
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We will consider the representations 1Zq c a (Ca), where £a is the concatena- 
tion of the $^ with + for the first r, and — for the last t. 

Proposition. 



Oifi^ dim(u Cij4 n t c 
nonzero irreducible if i = dim(u CjJ 4 H t c 



Proof. For the vanishing part we check that the conditions in proposition 
5.93 in [KnVj chapter V section 7 are satisfied. It is sufficient to show that 

^C>^(<J := U(B) ®-, c>A Z* A (9.5.7) 

is irreducible. Here Z£ is the 1— dimensional module corresponding to 

"c,A 

£a ~ p(u c ,a), with 



2 ^ a - 

qgA(ua, c ) 

The derived functors are normalized so that if W has infinitesimal character 
X, then so do the lZi c (W). We prove a slightly more general result. Write 
the parameter of an induced module as in (|9.5.7j) as 

(ai, . . . , &i; a 2 , . . . b 2 , ■ ■ ■ ; a m , . . . , b m ; -r + 1/2, . . . , -1/2) (9.5.8) 

where each (a^, . . . ,bi) is a string i.e. the coordinates go up by one. Each 
string encodes a 1-dimensional character on a gl{bi — ai + 1). The last one 
with — r + 1/2 denotes the trivial character on g(r). 

Lemma. Assume that the parameter in equation \9. 5. 8\) satisfies the follow- 
ing. 

(1) For each i,j either 

CLi < CLj < bj < bi 

or 

a-i < Oj < &j < &i. 

(2) ai + 6i < 1. 

(3) |aj|, < r-1/2. 



Then the module in equation (9.5.7) is irreducible. 

Proof. Any factor of (|9.5.7p would have to be a lowest weight module which 
is a generalized Verma module for q. Thus its parameter would be 

(ai, . . . , &i; • • • : a' k , . . . , b' k ; -R' + 1/2, . . . , -r' + 1/2) (9.5.9) 

where the coordinates in each (aj, .. . are increasing and differ by in- 
tegers, and the same is true for r',R' € N. These strings encode finite 
dimensional representations on gl(bi — Oj + 1) and g(r) respectively. To be 
a factor of ([9X7) . 

(1) the coordinates of (|9.5.9p have to be in the same Weyl orbit as the 
coordinates (|9.5.8p (so that the infinitesimal character are the same) . 
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(2) the difference between (I9.5.9P and (|9.5.8I) must be a sum of roots in 
A(u). 

Given the assumptions, (|9.5.8p and (|9.5.9)) must coincide except for some 
subset of the i for which aj + 6j = 1, and 

(<4 ...,&•) = (-bi,...,-a,i). 

We do an induction on the number of such i. The module (|9.5.8p is irreducible 
if there are no such i. Suppose there are such i. Then the possible factors are 
of the same kind, but with fewer such i. The theory of asymptotic expansions 
of characters outlined in section 18.11 coming from [BVlj applies. Any two 
induced modules have the same leading term. So if (|9.5.8p contains a factor 
of the type (|9.5.9p , the remaining factors would have to have strictly smaller 
Gelfand-Kirillov dimension. But the infinitesimal character is of the special 
unipotent type considered in [BV2j . so there are no such factors. □ 



The notions and results about associated cycles in chapter [8] section 18.41 
apply. By the corollary 18.41 T^q™ (^j4) is irreducible or zero because 

the multiplicity of the corresponding nilpotent orbit in s c in AV is 1. To 
show that l^™} Uc ' Ar[tc \iA) 7^ 0, we use the bottom layer K— types defined 
in chapter V section 6 of |KnVj . To simplify the notation slightly, we write 

a\ = %2k!+i, h = x 2kl , ■ ■ ■ ,a r = x 2 k r , b r = x 2 k r +i r even, 
ai = x 2 k 1 +i, h = x 2kl , . . . ,a r = x 2kr+ i, b r = x 2kr r odd, 



(9.5.10) 



and u c for u Cj a- Let also a := X] a j> & := Yl &r Note that \aj — bj\ = 1, and 
also \a — b\ = 1. Then 

H := £ + 2p(u n s) - p(u) = (l a , p ~ a | l b , (f- b ) (9.5.11) 

is dominant, therefore bottom layer. The aforementioned results then imply 
the nonvanishing. □ 

We now show that there are 2 m distinct representations. To do this we will 
compute Langlands parameters. We rely on the notation and conventions 
in chapter 11 of [ABVj . Many details are in the references to earlier work 
given there. In [ABV| a Langlands parameter is a triple A = (A can , Hti->, IRjj), 
where A can is an irreducible representation of a stable Cartan subgroup 
-ffR (denoted Tr in |AB V] ) . Attached to such data is a standard module 
X(A), with a canonical irreducible subquotient M(A). We will determine 
A := dA can and the lowest K— types of the derived functor modules con- 
structed earlier. The Lie algebra of H decomposes according to the ±1 
eigenvalues of 9 into t) = t+ a. Then A = (A, v). Recall from |V3j chapter 5 
that the centralizer of a is a quasisplit 9— stable Levi component [, and that 
M(A) is determined by the fact that it contains a lowest K—type fi related 
to A by the formula A = fi + 2p c + p + v where v = ^ Cj«i is a combination 
of strongly orthogonal imaginary roots with coefficients < Cj < 1/2. 
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To compute A and fj,, we will need to use the intermediate parabolic 
subalgebras 

q c ,A C q' c>A C q c ,A C C (9.5.12) 

with Levi components 

L = uiax, b\) x • • • x u(a r , b r ) x g(n — a — b), 

(9.5.13) 

►A = tt ( a > &) x S( n ~ a 

Apply induction in stages from q c ^A to q' c A first. On the factor g(n — a — 6) 
the X— type in (|9.5. llj) is trivial, so the Langlands parameter is that of the 
spherical principal series. Similarly on the u(a,j,bj) assume the infinitesimal 
character is Xj := (max(aj, bj), . . . , min(aj, 6-,)) with the coordinates going 
down by 1, and the Langlands parameter is that of a principal series with 
the appropriate 1-dimensional Langlands subquotient. Let \]a C l' c A be the 
the most split Cartan subalgebra. In particular the real roots are 

a d '■= e d+ e d+p, dj < d < aj+min(qj, bj), < s < r— 1. (9.5.14) 

j<s j<s 

For each factor u(aj,bj) the Langlands parameter is of the form (Xj,Vj) 
where Xj G \)a H 6 c , and G ij^n s c . Then 

Xj = (l/2 a J | 1/2 6 ?), (9.5.15) 

while 

(vj,a>d) = max(aj, &j) — (d — a.j) (9.5.16) 

Proposition. The representations ^qf ^ An have Langlands param- 

eters (X G ,v) where X G is obtained by concatenating the Xj in \9. 5.15\) and 
v satisfies 119. 5.16]) . 

Proof. We write l' c = l' cA and [' = \' cA fl g. There is a nonzero map 
X[/(A G ,— v) — ► L[i(X G ,— v) given by the Langlands classification. Thus 
there is a map 

qc ' , (9.5.17) 

which is nonzero on the bottom layer isT— type (|9.5.11j) . On the other hand, 
because these are standard modules, 

^(X v (X G ,u)) = l^ xG ^ ^=dim« c nu c , _ 

I otherwise. 
The proof follows. □ 
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9.6. 

Theorem. The spherical unipotent representations L{\o) with & even are 
unitary. 

Proof. We present the details for G = SO(n + 1, n). Write fl(ra) for the 
Lie algebra containing O sp i the split real form of O c , same as the support 
AC{L{xq))- There is a (real) parabolic subalgebra p + with Levi component 
m + := gl{n\) x • • • x gl(nk) x g(n) in g + of rank n\ + ■ ■ ■ + nk + n, such that 
the split form Of pl of 

C+ := (1, 1, 3, 3, . . . , 2a - 1, 2a - 1, 2a + 1) 

for some a depending on (2xq, . . . , 2x2 m )- is induced from O on g(n), trivial 
on the gFs. We will consider the representation 

I (it) := IndfL [tHu ® ••• ®triv®ir}. (9.6.1) 

We show that the form on I(vr) induced from ir is positive definite; this 
implies that the form on ir is definite. We do this by showing that the 
possible factors of I(tt) have to be unitary, and the forms on their lowest 
K— types are positive definite. 

By the results in chapters [8] and [9j more specifically section [973]. and par- 
ticularly proposition (1) in section 19.31 we conclude that there are 3° • 2 a 
unipotent representations in the block of the spherical irreducible represen- 
tation; all the factors of I(tr) are in this block. Here 3 a is the number of real 
forms of 0+, and 2 a is the number of representations in the corresponding 
Lusztig cell. We describe how to get 3 a -2 a distinct representations. For each 
real form Oj~ of 0+ we produce one representation ir such that AC(tt) = . 
Then theorem (2) of 19.31 implies that there is a Harish-Chandra cell with 2 a 
representations with this property, since A{0) = A(O) = (Z/2) a . Since 
these cells must be disjoint, this gives the required number. 

From section 18. 1( each such form Oj~ is ^-stable induced from the trivial 
nilpotent orbit on a parabolic subalgebra with Levi component a real form of 
gl(l)xgl(3) x • • • xgl(2a— l)xg c (m). Using the results in [KnVj . for each such 
parabolic subalgebra, we can find a derived functor induced module from 
an appropriate 1-dimensional character, that is nonzero and has associated 
variety equal to the closure of the given real form. Actually it is enough 
to construct this derived functor module at regular infinitesimal character 
where the fact that it is nonzero irreducibile is considerably easier. 

So in this block, there is a cell for each real form of 0~£ , and each cell has 
2 a irreducible representations with infinitesimal character Xo- particular 
for O sp i, the Levi component is u(l, 0) xtt(l, 2) x«(3, 2) x • • • xso(a, a+1). For 
this case, section [931 produced exactly 2 a parameters; their lowest K— types 
are of the form [i e {n — k, k). These are the only possible constituents of the 
induced from L(xq). Since the constituents of the restriction of a /x e (n — k, k) 
to a Levi component are again /x e (m — l,l)'s, the only way L{xq) can fail 



DAN BARBASCH 



to be unitary is if the form is negative on one of the K— types fJ, e (n — k,k). 
But sections l5l and HT3l show that the form is positive on the K— types \i e of 



10. Irreducibility 

10.1. To complete the classification of the unitary dual we also need to 
prove the following irreducibility theorem. It is needed to show that the 
regions in theorem 13.11 are indeed unitary in the real case. 

Theorem. Assume O is even, and such that = x^ = Xj+i for some i. 
Let m = gl(xi) x q(u — Xi), and 0\ C Q(n — Xi) be the nilpotent orbit obtained 
from O by removing two rows of size Xj. Then 

L(x d ) = I nda^l. )xG{n _ x . ) [triv <g> L(x 6l )]. 

In the p— adic case this follows from the work of Kazhdan-Lusztig ( }BMlj ). 
In the real case, it follows from the following proposition. 

Proposition. The associated variety of a spherical representation L(x&) 
is given by the sum with multiplicity one of the following real forms of the 
complex orbit O c . 

Type B, D: On the odd sized rows, the difference between the number 

of + 's and number of — 's is 1, or -1. 
Type C: On the even sized rows, the difference between the number of 

+ 's and number of — 's is 1, or -1. 

The proof of the proposition is lengthy, and follows from more general re- 
sults which are unpublished ( [B5] ) . We will give a different proof of theorem 
110.11 in the next sections. 

Remark. When (D\ is even, but O is not, and just x% = Xi+i, the proof 
follows from |BMlj in the p— adic case, and the Kazhdan-Lusztig conjectures 
for nonintegral infinitesimal character in the real case. We have already used 
these results in the course of the paper. □ 

The outline of the proof is as follows. In section |10.2| . we prove some 
auxiliary reducibility results in the case when O is induced from the trivial 
nilpotent orbit of a maximal Levi component. In section [10.3\ we combine 
these results with intertwining operator techniques to complete the proof of 
theorem 110.11 

10.2. We need to study the p— induced modules from the trivial module on 
m C g(n) where m = gl(n), or in some cases m = gl(a) x g(b) with a + b = n. 
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Type B. Assume O corresponds to the partition 2xq = 2x\ = 2a in sp(n, C). 
The infinitesimal character is (—a + 1/2, . . . ,a — 1/2) and the nilpotent orbit 
O c corresponds to (1, 1, 2, . . . , 2, 3). We are interested in the composition 

2a-2 

series of 

Ind GL(l)l triv }- t 10 - 2 - 1 ) 

There are three real forms of O c in so(2a + 1, 2a), 

+ -+ +-+ - + - 

+ - + - + - 

- + - + - + 

+ - + - + - 

- + - + - + 
+ + + 

+ - + 

The associated cycle of (110. 2. ip is the middle nilpotent orbit in (I10.2.2P 
with multiplicity 2. Section [6] shows that there are at least two factors 
characterized by the fact that they contain the relevant K— types which are 
the restrictions to S[0(2a + 1) x 0(2a)] of 

M0 a ;+)®M0 a ;+) 

10.2.3 

Ml,0 a - 1 ;-)®M0 a ;-). 1 ; 



(10.2.2) 



Thus because of multiplicity 2, there are exactly two factors. One of the 
factors is spherical. The nonspherical factor has Langlands parameter 

A G = (1/2, 0, . . . ,0 | 0, . . . , 0), 

W 1 ; 10.2.4 

v = (0, a - 1/2, a - 1/2, ... , 3/2,3/2, 1/2). 

The Cartan subalgebra for the nonspherical parameter is such that the root 
ei is noncompact imaginary, e^, ei±£j with j > i > 2, are real. The standard 
module X(\ G ,v) which has X(X G ,u) as quotient is the one for which v 
is dominant. Thus we conjugate the Cartan subalgebra such that e<i a is 
noncompact imaginary, ej,£j ± ej with i < j < 2a are real, and the usual 
positive system A + = {e^, ej ± £j}i<j- 

Type C. Consider O which corresponds to the partition 2xq = 2x\ = 2a + 
1 < 2x2 = 2b + 1 in so(n, C). The infinitesimal character is 

(-a,...,a)(-6,...,-l) (10.2.5) 

The nilpotent orbit O c is induced from the trivial one on gl(2a + 1) x g(6) 
and corresponds to 

(1 J _^,2,2,3,...,3). (10.2.6) 

2f>-2a-2 2a 
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We are interested in the composition series of 



lna GL(2a+l)xG(b) 

There are three real forms of (|10.2.6|) . 



[triv]. 



+ 




+ 


+ 




+ 




+ 






+ 




+ 




+ 


+ 




+ 




+ 






+ 




+ 






+ 






+ 








+ 




+ 






+ 







+ - + 
- + - 



+ 



+ 



+ 
+ 
+ 



+ 



[10.2.7) 



(10.2i 



+ 



+ 



+ 



The AC cycle of (|10.2.7p consists of the middle nilpotent orbit in (|10.2.8p 
with multiplicity 2. By a similar argument as for type B, we conclude that 
the composition series consists of two representations containing the relevant 
K— types 

MO"), 

j.1 u i j.1 10.2.9 

These are also the lowest K— types of the representations. The nonspherical 
representation has parameter 

A G = (l/2 a ,0 b ,(-l/2) a ), 

v= (l/2 a ,0 6 ,l/2 a ). 



(10.2.10) 



Type D. Let O correspond to the partition 2xq = 2x\ = 2a + 1 in so(n,C). 
The infinitesimal character is (—a, . . . ,a). The real forms of the nilpotent 
orbit O are 



+ 



(10.2.11) 



- + 

There are two nilpotent orbits with this partition labelled /, II. Each of 
them is induced from m = gl(2a), there are two such Levi components. We 
are interested in the induced modules 



GL(2: 



(10.2.12) 



The multiplicity of the nilpotent orbit (|1Q.2.11|) in the AC cycle of (|10.2.12p 
is 1, so the representations are irreducible. 
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We summarize these calculations in a proposition. 

Proposition. The composition factors of the induced module from the triv- 
ial representation on m, where m = gl(2a) for SO(2a+l, 2a) and SO(2a, 2a), 
or gl(2a + l) x g(b) in type Sp{Aa + 2b + 2), all have relevant lowest K— types. 
In particular, the induced module is generated by spherically relevant K— types 
Precisely, 

Type B: the representation is generated by the K— types of the form /j, e , 
Type C: the representation is generated by the K— types of the form fi Q , 
Type D: the representation is generated by the spherical K—-type /i e (0) = 
A«o(0). 

10.3. We now prove the irreducibility result mentioned at the beginning of 
the section in the case of q of type B; the other cases are similar. Recall that 
we denote O = (2xq, 2x±, . . . , 2x2 m ). Let 0\ be the nilpotent orbit where we 
have removed two entries equal to 2a from O. Let m := gl(2a) x g(n — 2a). 
Then L(xq) ls the spherical subquotient of the induced representation 

I(a, L( X6l )) := Indl\{-a + 1/2, . . . , a - 1/2) ® L( X6l )]. (10.3.1) 

It is enough to show that if a parameter is unipotent, and satisfies Xi-\ = 
Xi = Xi + i = a, then I{a^L{xo 1 )) i s generated by its K— types [i e . This 
is because by theorem 15.31 the K— types of type fi e in (|10.3.ip occur with 
full multiplicity in the spherical irreducible subquotient, and the module is 
unitary. We will use various irreduciblity results stated in section [2]) without 
mention. 

First, we reduce to the case when there are no < xj < a. Let v be the 
dominant parameter of L(xq), and assume i is the smallest index so that 
= a. There is an intertwining operator 

X (y) — > 7(1/2, ...,x - 1/2; . . . ; 1/2, . . . , - 1/2; v') (10.3.2) 

where I is induced from gl(xo) x • • • x gl^Xi-2) x g(n — Y2j<i—i x j) w hh char- 
acters on the gVs corresponding to the strings in (|10.3.2p . and the irreducible 
module L(v') on g(n — Ylj<i-i x j)- ^ ne intertwining operator is onto, and 
thus the induced module is generated by its spherical vector. By the induc- 
tion hypothesis, the induced module from (—a + 1/2, . . . , a — 1/2) <g> L{y") 
on gl(2a) x g(n — ^j<i x i) ^ s irreducible. The parameter v" is such that 
the induced module has infinitesimal character v' ', and contains L{y') as its 
spherical subquotient. But 

7(1/2, ...,x - 1/2; . . . ; 1/2, . . . ,x,_ 2 - 1/2; -a + 1/2, . . . ,0- 1/2; u") * 

I(-a + 1/2, . . . , a - 1/2; 1/2, . . . , x - 1/2; . . . ; 1/2, . . . , x 4 _ 2 - 1/2, v") 

(10.3.3) 

This module maps by an intertwining operator onto I (a, L(xo 1 )): so 
7(a,L(x c ) 1 )) is generated by its spherical vector. 
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So we have reduced to the case when 

Xn = x\ = xo = a, or 

(10.3.4) 

xo = < x\ = X2 = X3 = a. 

Suppose we are in the first case of (|1Q.3.4|) and m = 1. The infinitesimal 
character is 

(a - 1/2, a - 1/2, a - 1/2, . . . , 1/2, 1/2, 1/2), 

each coordinate occuring three times. The induced module 

I(-a + 1/2,..., a -1/2) (10.3.5) 

of fj(2a) is a direct sum of irreducible factors computed in section 110. 2\ 
in particular it is generated by K— types of the form [i e [2a — k,k) (with 
k = 0, 1). Consider the module 

/(a - 1/2; ... ; 1/2; -a + 1/2, . . . , a - 1/2), (10.3.6) 

induced from characters on GL(1) x ••• x GL(1) x GL(2a). It is a direct 
sum of induced modules from the two factors of (|10.3.5p . Each such induced 
module is a homomorphic image of the corresponding standard module with 
dominant parameter. So (110. 3. 6p is also generated by its fi e isotypic com- 
ponents. But then 

I(a - 1/2; . . . ; 1/2; -a + 1/2, . . . , a - 1/2) ^ 

(10 3 7) 

I(-a +1/2,..., a -1/2; a -1/2;...; 1/2) v 

so the latter is also generated by its /i e isotypic components. Finally, the 
intertwining operator 

I(a- 1/2;...; 1/2) — ► 1(1/2, ... ,a - 1/2) (10.3.8) 

is onto, and the image of the intertwining operator 

1(1/2,..., a - 1/2) — ► /(-a + 1/2, . . . , -1/2) (10.3.9) 

is onto L(— a + 1/2, . . . , —1/2). Thus the module induced from gl(2a) x g(a), 

/(-a + 1/2, . . . , a - 1/2; L(-a + 1/2, ... , -1/2)), (10.3.10) 

is generated by its \i e isotypic components. Since the multiplicity of these 
K— types in (jl0.3. 10|) is the same as in the irreducible spherical module, it 
follows that they must be equal. 

Now suppose that we are in the first case of (|1Q.3.4|) and m > 1, or in the 
second case, and m > 2. The parameter has another x^m-i < ^2m- We use 
an argument similar to the one above to show that the module 

I(-x 2m -i + 1/2, ...,x 2m - 1/2, L(xo 2 )), (10.3.11) 

induced from gl(x2m~i+X2rn) xg(n- X2m-\ — x 2m ), where (D 2 is the nilpotent 
orbit with partition obtained from O by removing 2x2 m -i-, 2x2m, is generated 
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by its \i e isotypic components. The claim then follows because the induced 
module is a homomorphic image of (110. 3. lip . Precisely, X(y) maps onto 

I(x 2m -i + 1/2, . . . ,x 2m - 1/2; 1/2, ...,x - 1/2; . . . ; 1/2, . . . , x 2m -2 - 1/2; 

L(-x 2m -i + 1/2, -x 2 m-l + 1/2, • • • , -1/2, -1/2)) 

(10.3.12) 

So this module is generated by its spherical vector. Replace L{— x 2m -\ + 
1/2, -x 2m _i + 1/2, . . . , -1/2, -1/2) by I(-x 2m -i + 1/2, • • • , 2 2m _i - 1/2). 
The ensuing module is a direct sum of two induced modules by section 110.21 
They are both homomorphic images of standard modules, so generated by 
their lowest K— types, which are of type /x e . Next observe that the map 

/(x 2 m-i + 1/2, ■ ■ ■ , x 2m - l/2;l/2, ...,x - 1/2; . . . ; 1/2, . . . , 2 2m _ 2 - 1/2; 

- x 2m _i + 1/2, . . . , £ 2m _i - 1/2) — > 

I{-x 2m -i + 1/2, . . . x 2m - l/2;l/2, . . . , x - 1/2; . . . ; 1/2, . . . , x 2m _ 2 - 1/2) 

(10.3.13) 

is onto. So the target module is generated by its /x e isotypic components. 
The module 

1(1/2, . . . , x - 1/2; . . . ; 1/2, . . . , x 2m _ 2 - 1/2) (10.3.14) 

(the string (— 2 2m _i+l/2, . . . , x 2m — 1/2) has been removed) has L(— 2 2m _ 2 + 
1/2, . . . , 1/2) as its unique irreducible quotient, because it is the homomor- 
phic image of an X{y) with v dominant. Therefore it is generated by its 
spherical vector. Combining this with the induction assumption, we con- 
clude that 

/(-x 2m _! + 1/2, ...,x 2m - 1/2; -a + 1/2, . . . , a - 1/2; L(6 3 )) (10.3.15) 

is generated by its [i e isotypic components. Here O3 is obtained from (D 2 by 
removing two entries equal to 2a. It is isomorphic to 

I(-a + 1/2, . . . , a - 1/2; -x 2m . x + 1/2, ...,x 2m - 1/2; L(6 3 )). (10.3.16) 

Finally, the multiplicities of the /i e isotypic components of I{—x 2m -\ + 
1/2, ... , x 2m — 1/2; L{0-i)) are the same as for the irreducible subquotient 
L{0\). This completes the proof of the claim in this case. 

Remains to consider the case when m = 2 and xq = < x\ = x 2 = X3 = 
a < X4. In this case, the module 

/(a+1/2,... , 24-1/2; -a+1/2,... , a-1/2; -a+1/2, . . . ,a-l/2) (10.3.17) 

is generated by its /i e isotypic components because of proposition 110.21 and 
arguments similar to the above. Therefore the same holds for 

I(-a + 1/2, . . . , z 4 - 1/2; -a + 1/2, . . . , a - 1/2), (10.3.18) 

which is a homomorphic image via the intertwining operator which inter- 
changes the first two strings. But this is isomorphic to 

I{-a + 1/2, . . . ,a - 1/2, -a + 1/2, ... ,24 - 1/2). (10.3.19) 
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Then /(-a + 1/2, . . . ,a- l/2,L(-x 4 + 1/2, . . . ,-1/2,-1/2) is a homomor- 
phic image of (|10.3.19p so it is generated by its /i e isotypic components. By 
section 15.31 the multiplicities of the fi e isotypic components are the same in 
I(-a + 1/2, . . . , a - 1/2, L(-x A + 1/2, . . . , -1/2, -1/2)) as in L(x&)- 

This completes the proof of theorem 110. 1 L □ 
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